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I. THE NEED OF SUCH AN INVESTIGATION. 

Hundreds of thousands of children throughout the civilized 
world are each year confronted with the task of mastering the ele- 
mentary facta of number. These number facts or processes are 
the result of centuries of development. They are now an indis- 
pensable part of human knowledge. They, therefore, -constitute 
an absolutely unquestioned part of every system of elementary 
education. Any additional knowledge that may tend to simplify 
or to facilitate the mastery of these facts must be of vahie to the 
great army of teachers upon whom devolves the task of teaching 
them, and of even more value to the greater army of children whose 
task it is to learn them. It is helpful for both teacher and pupil 
to know where the points of difficulty lie, because it stimulates both 
to more intense activity when these points are reached. This ac- 
tivity finds expression on the part of the teacher in the invention 
of devices for teaching, in the development of methods of instruc- 
tion. With the pupil this activity manifests itself under proper 
guidance in greater attention, in greater effort to get and hold the 
fact to be acquired or the problem to be mastered. Like one about 
to perform a feat of strength, he rouses the energy which he thinks 
may be sufficient to meet the demands of the occasion. We have, 
therefore, sought by this investigation to determine the relative 
difficulty of the elementary combinations, recognized generally 
as such in the United States, of the two most fundamental pro- 
cesses in arithmetic, namely, addition and multiplication. We 
do not presume that this study is in any way commensurate with 
tbe far-reaching application of the problem involved. We can only 
claim that what follows describes the most comprehensive investi- 
gation of this particular field of inquiry that has been made up to 
the present time. 
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It is not an uncommon thing in the school room and out, when 
the combinations are learned by "tables," to find little or no dis- 
tinction in the emphasis placed upon the various facts of a given 
table. And the same is sometimes true even among the various 
tables themselves. Two plus three receives juat about as mn<di at- 
tention as does 2 + 7 ; and 3X1 receives about the same em- 
phasis as does 2 X 9j though in both cases the difference in diffi- 
culty is at once apparent The most serious objection to this 
method of procedure is the woeful waste of time involved in re- 
peating again and again facts that need but few repetitions to 
make their recall automatic. Nor can it be said that the writers 
of text-boots of primary arithmetic have kept the matter of relative 
difficulty sufficiently in mind. Their chief aim seems to have been 
a logical development, perhaps a psychological development, of all 
the element-ary number facts in their regular order, and the giving 
of comprehensive miscellaneous review drills from time to time as 
the progress of the work would seem to demand. To the credit of a 
few be it said that they have designated, somewhat indefinitely, 
to be sure, a few of what might be deemed difficult cMiibinations, 
but they have, for the most part, laid the burden of detennining 
the emphasis necessary to their mastery upon the teacher. This 
is doubtless only partly as it should be. The ^vriter of such a text- 
book should know rather definitely beforehand just where inherent 
difficulty lies, so that he may present his material accordingly, and 
the teacher should have some more specific guide than is furnished 
in the ordinary text as to the place and amount of emphasis neces- 
sary for best results. She should know about what results she may 
reasonably expect in teaching a given group of number facts with a 
given amount of drill. It is the object of the present investigation 
to furnish, as far as may be, just this information. 

In order to determine just what emphasis was given the various 
combinations in addition, as shown by frequency of reenrrence, 
the writer made a detailed study of three of the best number 
primers at present on the market, (See Table I.) These books 
were written with the idea of being put into the hands of the child 
at the end of the first two or three weeks of his school experience, 
and suggesting sufficient material to occupy his attention until 
about the end of the first half of the second year. 
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aaOWIMG THE NUWBBB OF FBBBENTATIONa GIVEN 
COMBIKATIOSS IN TUBEE OF THE BEST 

Combination. No. 1. No. 



y + 


1 


76 


5 


1 + 


12 


24 


49 


2 + 


27 




47 


S + 


17 


33 


50 


4 + 


13 


29 


55 


5 + 


14 


50 


38 


6 + 


5 


31 


47 


7 + 


5 


30 


34 


8 + 


3 


38 


41 


9 + 


5 




27 


1 + 1 


44 


88 


42 . 


2 + 1 


85 


140 


114 


3 + 1 


80 


72 


104 


4 + 1 


63 


60 


95 


5 + 1 


44 


58 


92 


6 + 1 


38 


41 


93 


7 + 1 


30 


55 


79 


8+1 


36 


62 


78 


9+1 


20 


24 


61 


2 + 2 


71 


47 


65 


3 + 2 


130 


114 


134 


4 + 2 


105 


71 


138 


5 + 2 




75 


109 


6 + 2 


61 


75 


128 


7 + 2 


59 


53 


103 


8 + 2 


48 


41 


92 


9 + 2 


40 


26 


94 


3 + 3 


58 


46 


45 


4 + 3 


109 


72 


119 


5 + 3 


08 


75 


103 


6 + 3 


66 


60 


93 


7 + 3 


55 


38 




8 + 3 


42 


21 


76 


9 + 3 


43 


30 


78 


4+4 


42 




35 


5 + 4 


72 


45 




6 + 4 


34 


36 


99 


7 + 4 


38 


20 


80 


8 + 4 


39 


23 


90 


9 + 4 


33 


18 


77 


5 + 5 


36 


47 


49 


6 + 5 


33 


29 


83 


7 + 5 


30 


24 


72 


8 + 5 


25 


27 




9 + 5 


18 


20 


76 


6 + 6 


11 


11 


39 


7 + 6 


15 


27 


98 


8 + 6 


10 


17 


85 


9 + 6 


11 


IS 


71 


7 + 7 


3 


8 


36 


8 + 7 


9 


19 


17 


9 + 7 


9 


19 


66 


8 + 8 


5 


7 


38 


9 + 8 


11 


16 


69 


9 + 9 


5 


9 


20 


Total Presentations 


2105 


2298 


3982 
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In determining the number of presentations of the various com- 
binations, continuous counting by S's, S's, 4'8 ajid S's to a certain 
anm was omitted. Primer N"©, 1 thus gave 2,105 presentations; 
No. 2 gave 3,298 presentations, and No. 3 gave 3,983 presenta- 
tions. A comparison of the corresponding columns of Table I 
shows an interesting lack of uniformity in the relative number of 
presentations of the facts involved. If the number of presenta- 
tions given by the three authors to the variovis combinations is to 
be regarded as a measure of the relative difficulty of these combina- 
tions, then No. 1 would have us believe that 3 -|- 2 is the moat 
difficult fact to fix in the pupil's mind, and that + is the least 
difficult. No. 2 would have us believe that 2 + 1 i^ the most diffi- 
cult and needs 140 repetitions during the time given to fix it in 
the child's mind, while 8 + 8 is the least difficult and needs but 
7 repetitions to accomplish the same result. No. 3 says that 
4 -[- 2 is the most difficult and will require 138 repetitions, while 
the child can learn + in 5 repetitions, and 9 + 9 in 20 repe- 
titions. Considering the total number of presentations given, we 
should expect No. 3 to give approximately twice as many repeti- 
tions of each combination as No. 1, yet they give 1-4-1 practically 
the same number of times, while No. 2 gives t^vice as many repeti- 
tions of this fact as either of the others. No, 2 would indicate that 
+ 0, 3 + 1, 4 + 2, 5 + 2, 6 + 2, 4 + 3, and 5 + 3 are of 
practically the same difficulty, while the difference in difficulty 
in these combinations as shown by No. 1 and No. 3, varies con- 
siderably. The fewer repetitions of the double numbers; as, 
7 + 7, with No. 3 and No. 3 may be attribnted not to a belief 
that they may be easier than others, but to the fact that there 
are no reverse forms, as with 7 + 5, which also is made to occur 
as 5 + 7, There is a double significance in these comparisons : 
(1) there is no agreement among authors as to the proper num- 
ber of presentations to be given to the various facta; and (2) the 
number of repetitions of a given combination by the same author 
is in no sense a guide to the teacher in determining the relative 
difficultv of that combination. 
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n. BECOONinON IN CURRENT PEDAQOOICAL LITEBA- 

TUSE AND SYLLABI OF THE NEED OF SUCH 

AN INVESTiaATION. 

That there is in this matter of relative difficulty of number 
combinations in both addition and multiplication a problem worthy 
of investigation has been pointed out by such specialists in edu- 
cation ae Prof. Henry Suzzalo (31), Dr. A, Duncan Yocum 
(44), and Dr. C. W. Stone (36) ; and indeed the best teachers 
of primary number work have for a great many years recognized 
its existence, and have acted upon their more or less satisfactory 
opinions and observations in their teaching practice. Certain 
investigations along this line have even been made, in this country 
by Phillips (23), Griggs (5) and Phelps (22), and in Germany by 
Doring (2), the methods and results of which we shall take the 
liberty of giving and discussing in subsequent pages.' Such writ- 
ers on special method as JIcMurry (17), Yoewm (46), Quigley 
(26), Eigler (28), and Miss Gildemeister (3), have each made 
important su^estions arising out of their recognition of a dif- 
ference in difficulty of either addition or multiplication combina- 
tions, or botb. So also has one of the most recent state mono- 
graphs (21) on the teaching of arithmetic this to say: "Much 
waste of effort will be avoided if these facts (of addition), are 
separated into groups according to their difficulty," , . . and 
again, "the difficulties in addition are largely because a few simple 
combinations are troublesome such as 9 + 7, 8 + 5, 8 + 7, 
7 + 4, 5 + 3, 5 + 3, 8 + 5. The stress of drill should be 
placed upon these and other points of difficulty." Doubtless much 
other evidence might be found to show a still wider recognition 
of the existence of an important problem here, but that which is 
cited above seems quite sufficient for our purpose. 

'P. Ranscliburg (27), of Budnpeet, in liia Articles Eur physiologischeo und 
pathologiBehen PaycboloBie der elementaren Rechenartea, referred to by Ernest 
C. UcDougle (15) in bis excellent summary of studies made in arithmetic as 
treating the problem of "relative difficulty," deals with the relative difficulty 
of (he four fundamental processes, comparing the results obtained from normal 
and backward cbildren. 
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m. WHAT HAS BEEN DONE TOWABD THE SOLUTION OF 
THE PBOBLEH, AND THE METHODS OF ATTACK. 

1. THE WORK AKD RESULTB OF PHILLIPS. 

The earliest attempt reported in this country to gather any 
systematic information along the line of our inquiry was made in 
1897 by Mr. D. E. Phillips (23), then of Clark University. Mr. 
Phillips sent out a syllabus to 616 persons, 72% of whom were 
teachers, and the other 28% men and women whose occupations 
are not designated. Among a number of other questions thi« 
was asked: "What numbers give moat trouble in adding or mul- 
tiplying?" There were 440 returns received, 157 of which gave 
7 and 9; 88, 7 and 8; 34, 6 and 7; 42, 7 only; 26, 3, 6 and 8. 
The others were miscellaneous. Seven is found in 327 cases, 9 
in 204. Pive say that 9 is easy, always one less than 10. In ad- 
dition to this, the errors in multiplication found in the papers of 
283 ninth grade pupils involving 1,095 problems or multiplica- 
tions, the majority of which contained three figures in the mul- 
tiplier and four in the multiplicand, were tabulated and are 
worthy of note. There were in all 691 mistakes in multiplication. 
Of these 186 were made in multiplying by 9 ; 195 by 8 ; 199 by 
7; §7 by 6; 9 by 5; 15 by 4; "3 by 2. (24). 



2, THE WOEK AND KESULTS OF OEIOGS. 

Mr. A. O. Gri^s (5), also of Clark TTniveraity, in an article 
published in the Pedagogical Seminary, September, 1912, en- 
titled "The Pedagogy of Mathematics," has done us the service 
of bringing together the work of Mr. Phillips and that of Pro- 
fessor Doring. Where there is a difference of results, he allows 
those of Professor Doring the preference for reasons that will 
appear in the following summary of the latter'e experiments. 
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3. THE WOKK AND RESULTS OF DOHING, 

Prof. Max boring's investigation (3) is one of two very 
satisfactory pieces of work that have been done up to the pres- 
ent time to throw more light on this particular problem.^ His 
study involved only the multiplication combinations up to 
10 X 10. He started out by asking a number of adults (mostly 
teachers, both men and women) to name the three elementary 
multiplication combinations which in the opinion of each, baaed 
upon his own private and his pedagogical experience, were the 
most difficult. The results were so surprisingly uniform that he 
extended the inquiry to 323 boys in age from nine to fourteen 
years. To each of these the same question was put in writing, 
and aft«r some deliberation each wrote down his opinion. To 
avoid the possibility of their hesitating to put down their real 
diiSculties, they were not required to write the answers to the 
combinations which they might give. 

In compiling the results, the numbers with their reverses, aa 
7X8 and 8X7, were tabulated under the same heading of 
8 X 7 as one fact. Sixteen combinations appear in 880 out of the 
1,053 opinions given. Sixteen and four-tenths per cent, of the 
opinions were eliminated as being unworthy of statistical ex- 
pression. Forty-nine per cent, of the opinions indicated 8X7 
to be the most troublesome combination, 34% stood for 9X7, 
30% for 9X8, 30% for 7X6, 21% for 9X6, &c. That the 
selection of the combinations indicated was not a mere chance 
selection is demonstrated by statistical formulae for determin- 
ing the mathematical probability and the possible variation there- 
from. 

From the sixteen combinations. Professor Doring next pro- 
ceeded to arrange the various tables in the order of diiRculty 
suggested thereby. JToting that the factor 7 appears moat fre- 

iC. L. Pheips of Leland Stanford University (22) in 1913 worked over from 
a. different point of view material collected by Otis and Davidson ["The Re- 
liability of Standard Scores in Adding Ability," EI. School Teacher, Oct., 18121 
from 238 eighth grade pupils to determine the frequency of error in addition 
eombinationa. For his resulte partially stated, see Table VIII. 
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qiiently in the opiniona tabulated, he concluded, as Dr. McMiirry 
also states (18), that the seventh row is the most difficult. For 
the sake of comparison we give below the order of difficulty thus 
obtained side by side with that su^ested by Dr. McMurry, Miss 
Gildemeister (4), and Professors Rocke, Roegers and Wolf (13). . 
The most difficult tables are placed on the left, the least difficult 
on the right o£ the table. 

TABLE II. (a). 

Diirins 7896453 10 2 1 

McMurrj 7963845 2 10.. 

GildemeiBter (omitting 0. 11 and 12) 8 T 6 4 3 5 9 10 1 2 

Rocke, Roeger & Wolf 7 9 6 3 8 4 5 10 2 1 

This is indeed an interesting comparison of opinion and ex- 
perience with the simplest possible method of statistical investi- 
gation. Professor Diiring recognizes three general orders of dif- 
ficulty: the 1st, 2d and 10th tables he regards aa "leicht"; the 
3d, 5th and 4th, as ''mittel schwer"; and the 6th, 9th, 8th and 
7th, "schwer." 

In order to cheek up his first results this investigator selected 
the ten most difficult combinations as determined by his first ex- 
periment and gave them as a test to 100 boys of the third school 
year. Among the 9,600 answers appeared 175 errors, or l.Sfo 
distributed as follows ; 

TABLE II. (b). 

New Place.. 123456789 10 

Combination, 9x7 Bx6 8x8 8x7 8x6 7x6 9x8 7x7 8x4 9X9 

No.Error9.. 25 25 23 21 21 17 14 13 12 4 

Old Place... 25716438 10 9 

The number of errors is, of course, so small as to deprive this 
part of the experiment of any conclusive results, yet it is inter- 
esting here to note the comparatively small divergence from the 
first order given, and this is all the more interesting when it is 
noted that special search is made in the third year of the German 
schools for the difficult combinations, and special drill is given 
upon them. 
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IV. AN ESTIMATE OF THESE INVBSTiaATIONS— THEIR 
LIMITATIONS IN SCOPE AND METHOD. 

If nothing else were accomplished by the contributions de- 
scribed above than, to call the attention of the teaching profes- 
sion to the existence here of an important factor in the acquisi- 
tion of number facts, they would even then be eminently worth 
while. But they have done more. In the first place they have 
suggested methods of attacking other problems of no less im- 
portance in school-room practice. In the second place they have 
shown that, while empiricism may be a reliable guide to such 
practice, it should be verified by careful experiment and receive 
the sanction of scientific investigation. Only thus can certainty 
and dignity be given to method. And, lastly, they have con- 
tributed information of real yalue in acquiring mastery over a 
very essential part of the school curriculum. 

If these things are true, how shall we justify further investi- 
gation along the lines indicated ? It will, in the first place, be 
noted that the relative difficulty of the addition combinations is 
scarcely touched upon, except for eighth grade pupils (see foot- 
note, page 13), while practically only sixteen of the multipli- 
cation combinations are statistically considered. The limitations 
first noted are justified in the light of the larger subject of "Num- 
ber and its Application," discussed by Mr. Phillips (23), so 
likewise with that of "The Pedagogy of Mathematics," discussed 
by Mr. Gri^s(5). But the limitations of Professor Doring's 
study were set by himself rather than by his subject to the 
"difficult cases," though his subject, "Zur Psyehologie des Kleinen 
Einmaleins," would suggest a somewhat more comprehensive view 
of the psychological side of the problem than he gives. 

Aside from the limited scope of the studies made, it is doubt- 
ful if the questionnaire method with adults or the "method of 
errors" in problems involving many figures in the multiplicand 
and multiplier, where some of the errors may be errors in "carry- 
ing," are greatly to be relied upon. So likewise with a method 
which depends largely upon the "opinions" of those tested. The 
data obtained by the use of such methods should at least be checked 
up by results obtained by methods not open to the objections that 
may he offered to any of the above mentioned modes of procedure. 
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V. THE PURPOSE OF THIS STUDY. 

It is the purpose of this study to determine, as nearly as may 
be, the relative difficulty of certain number facts, and to expreaa 

■ the data obtained in such a way that primary teachers may be 
furnished a more definite guide than now exists as to the emphasis 
that should be placed, upon these facts in their attempt to im- 

- part them to the child. It will also be a part of our task |to 
suggest some of the elements of method which may be profitably 
used to reach the ends of instruction in this field in a more ex- 
peditious way than has formerly been done. 



VI. THE PLAK OF THE INVESTIOATION. 

The teaching of both the addition and the multiplication com- 
binations requires, in the nature of the case, the breaking up of 
the work into certain groups, which must consist of fewer facts 
than are given in a single "table." It is, therefore, important 
that the teacher know the points of difficulty in each of the several 
groups as they are considered. In other words, it is important 
that a snn'ey of the whole field of elementary number facts be 
made rather than only the mountainous districts. Small climbs 
to the imtrained beginner may tax his energies quite as much as 
the more inaccessible peaks do to him who by training and ex- 
perience has learned the art of the mountain climber, and has 
developed in the 'process the physical powers necessary to the 
bigger task. 

1. DIFFICDLTT AS SHOWN IN LEARNING THE COMBINATIONS. 

Since children have to master the facts as presented, it has 
been our plan to study the difficulties which the children them- 
selves have experienced in the process. This, though probably 
the most difficult plan of attack — surely it has been the most 
tedious— has seemed to us to be the moat logical. It is the child's 
point of view that must in the end be most helpful for the teacher 
to get. 
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- 2. DIFFICULTY AS SHOWN BY EEEOKB MADE IN THE COMBINATIONS. 

We have also attacked the problem from another aide. We have . 
determined the relative number o£ errora made by large numbers 
of children in writing the combinations after these children have t 
been over the ground and were presumably familiar with them. - 
This plan differs from Professor Boring's second method of deter- 
mining his results only in the fact that we have in our experi- 
ments provided equal opportunity to make errors in all of the 
combinations, vphile he gave tests on only the ten combinations 
which he found most difficult in his first experiment. 

V 3. DIFFICDLTY AS SHOWN BY THE COMBINATIONS FOEGOTTEN. 



It also seemed wise to consider the relation between the various 
number facts from the standpoint of their permanence when once 
mastered. It is not infrequently the case that things easily 
learned are quite as easily forgotten. With this point in mind ' 
we have given tests in all the number facts to over 500 third grade 
children during the last week of their school work in June, and ' 
have given the same tests to the same children in the first week , 
of their school work in September following. We have thus 
determined the facts which are most likely to drop out of mem- 
ory during the long summer vacation. This should be of interest 
to a fourth grade teacher just taking a class promoted from the 
third grade. 

4. DIFFICULTY AS SHOWN BY THE TIME REQUIKED TO WEITE THE 
COMBINATIONS, 

And finally, since the more difficult a mental process is, the 
more thought it requires, the less skilful the individual is in its 
use, the greater is the time required in its accomplishment. It '- 
has, therefore, been also our plan to detennine the relative dif- 
ficulty of the various groups of facts as wholes by comparing the 
length of time required to write correct results to the various' 
combinations of which these groups were constituted. These tests, 
like that described immediately above, were given only to pupils 
who had been taught all the facts involved. 
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VU. THE LIMITS OF THE FIELD OF INVESTIOATION. 

1, THE TWO FUNDAMENTAI. PBOCESSES. 

Of the "four fundamental processes" in arithmetic, two may be 
regarded, in the light of modem methods, as fundamental, and 
the other two derivative. Subtraction may be regarded as addi- 
tion from another point of view, as far as the process goes, if the 
Austrian or making change method is used, and division is like- 
wise multiplication from another point of view. In the final 
analysis there is j-eally only one fundamental process, viz., addi- 
tion, all the others being derived from this. While multiplica- 
tion may be regarded as "shorthand" addition, and so taught, yet 
it is not the addition of a row containing seven 4's that a child 
should see when he says seven 4's are 28, The latter is purely 
an abstract process, entirely different psychologically from add- 
ing 4 and 4 and 4, &c., seven times. It is quite in accord with 
the best established pedagogical principles that the known process 
of addition be carried over and made the basis of its modifica- 
tion in multiplication, but its raison d'etre having been once 
pointed out the connection should cease as far as the process goes. 
During the process of multiplication introspection shows no con- 
scious association with the process of addition. This is not tnie in 
the case of subtraction, except when it has been taught as a separate 
process, nor is it the case with division, there being in the first 
ease a conscious background of addition, and in the second a 
conscious background of multiplication. Four from twelve leaves 
eight, because eight and four are twelve; four into twelve goes 
three times, because three times four are twelve. For these 
reasons we have selected what we regard as the two most funda- 
mental processes for the field of our investigation, and we believe 
that what may be found true in this field may be regarded in a 
very large measure as true in the related fields of subtraction and 
division within the same range. 
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2. THE FOKTY-FIVE ADDITION COMBINATIONS. 

If all the possible combinations in addition from to 9 are 
counted, it will be found that the total is 100. Of theae, 19 are 
combinations involving 0. There are then 81 combinations of the 
9 significant numerals. Of these, 9 admit of no reverse forma ; 
as, 1 + 1, 2 + 2, 3 + 3, &c. Excluding these 9 there are 72 
combinations, counting both direct and reverse forms; as, 
4 -\- 3^=1, and 3 + 4 = 7, If we regard both of these forms 
as one number fact, there are in these 73 combinations 36 num- 
ber facts, which, added to the 9 admitting of no reverse form, gives 
us 45 fundamental addition combinationa. In this investigation 
we have dealt with the 81 combinations in the teaching process 
for reasons which we shall presently explain, and we have done 
the same in the "time tests" (See VI 4), but in the final test to 
determine the number of errors made after the teaching process 
was finished only the 45 fundamental facts were given. Since 
the combination of a single number with never occurs in prac- 
tice — we are never required to add objectst to 4 objects or 4 
objects to objects— the necessity appearing only in the handling 
of numbers above 9, as when we say 8 and 10, or 30 and 15, it 
was though unnecessary to include the O's in the experiments. 
All the results in addition are, therefore, subsumed under 45 
fundamental heads. 

3. THE SEVENTY-EIQHT MULTIPLICATION COMBINATIONS. 

In this country it is customary to teach the multiplication 
tables up to 12 X 12. It is also generally the custom not 
to teach the combinations with as a part of the tables, they 
being left till they are required in column multiplication. The 
combinations with the ones, however, are taught, at least in the 
form in which the one appears in the second factor, or is used as 
the multiplicand. We hear, for instance, two I's, three I's, four 
I's, &c., at the beginning of each table. Not coqnting the com- 
binations using as a factor, there are 144 combinations from 
1 X 1 to 12 X 12, inclusive. Of these 12 have no reverse form; 
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as, 1 X 1, 2 X 3, 3 X 3, &c. Excluding these 12 there are 132 
combinations counting both the direct and the reverse forms; as, 
7 X 4 = 28 and 4 X 7 = 28. If we regard both of these as 
one number fact, there are in these 132 combinations 66 funda- 
mental facts, which, added to the 12 admitting of no reversions, 
gives us in all 78 fundamental facts in all the multiplication 
tables. While the multiplication combinations have been taught 
in both direct and reverse forms for reasons which we shall sub- 
sequently adduce, and the "time tests" were made to include 
both of these forms, as in the case of addition, only 78 facts were 
required in the final testa, and the results of all were subsumed 
under the 78 fundamental heads. 



i. THE NECESSITY AXD ADVANTAGES OF TEACIIINO BOTH TIRECT 
AND REVERSE F0EM8. 

One of the earliest problems which confronted us in conducting 
this investigation was whether we should take up the "tables" 
in addition and multiplication in the time honored way, or 
whether we should reduce the number of combinations to the 
forty-five fundamental addition facts and the seventy-eight fun- 
damental multiplication facts. Upon the decision on this point 
depended a most important factor in the method of presenting 
the work. If it could be shown that a pupil who knew perfectly 
4 "i- 7^ 11, would know equally well 7 + 4 = 11, or if it could 
be shown that a pupil who knew surely 4 X 9 ^ 36, would Imow 
with equal certainty 9 X 4^36, this would entirely eliminate 
the teaching of all reverse forms. 

a. Tests in Addition. — In order to determine what was pos- 
sibly true in regard to this matter in addition, a test was made 
with 29 children, 14 boys and 15 girls, in the lower half of the 
first grade. The experiment began on October 28th and was con- 
cluded November 1st, 1912. The children had been in school 
since the middle of September, and had already learned a few 
of the simpler addition facts. The following facts in the form 
indicated were' selected for the drill: 6 + 8, 7 + 6, 9 + 8, 
8 + 7, 9 + 6. These facts were drilled upon with equal oral 
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and written emphaais from Monday till Thursday, inclusive. On 
Friday morning at ten o'clock, after sixty minutes in school, a 
written test was given on the forma as drilled. At eleven-twenty 
o'clodi of the aame morning, forty-five minutes after a twenty- 
minute recess and singing period, the same teat was given in the 
reverse form. The results are given below: 

No. Total % 

Pupils. «+8 7-1-6 6+8 8+7 9+6 Correct. Correct 

Direct Form 29 29 29 2T 29 27 141 97.2 

Reverse Form 29 21 2S 19 20 20 lOS 72.3 



Out of a possihle 145 correct results it will be noted that ten 
times as majiy errors were made in the reverse form as in the 
direct form test. 

b. Tests in Multiplication. — At the same time that the experi- 
ment in addition was being conducted a similar experiment in 
multiplication was being carried on with 40 pupils, 20 boys and 
20 girls, in the lower half of the second grade. In this experi- 
ment there was only one-fourth as much written drill as oral drill. 
The final test in the direct form was given at ten a. m. on Novem- 
ber 1st, and that in the reverse form at eleven o'clock on the same 
morning, fifteen minutes after a ten-minute recess. The results 
are given in the following table : 

No. Total % 

Pupils. 3X4 7X3 6x4 5X3 4X8 Correct. Correct, 
Direct FortQ 40 40 39 38 38 38 193 96.5 



The selection of 3 X 4 as one of the combinations was doubtless 
not well made on account of its manifest ease, yet even in this ■ 
experiment nearly three times as many errors were made in the 
reverse form test as in the direct form test. 

c. Oondusion. — From these experiments we concluded that, 
while most of the direct form teaching could doubtless be carried 
over and applied to the reverse form, not a sufficient amount was 
transferred to justify the teaching of one form and omitting to 
teach its reverse, and since the time of Grube (1842), it may 
be said that the teaching of both forms has been in accord with 
the best pedagogical practice. We, therefore, have double justi- 
fication for the plan pursued in this investigation. 
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Vm. GBOUFINQ. 



THK ADDITION COilBINATIOXS. 



The necessity of teaching hoth the direct and reverse forms 
naturally brought up the question as to the order in which they 
should be taught. This in turn involved still another problem, 
that of grouping the combinations to be taught. Should we take 
one table at a time in what might be regarded as the logical order, 
or should we take a psychological order, such as is pointed out 
by Dr. Yocum (46) for the addition facta, or one such as is 
indicated by Superintendent Rigler (28) in the Portland, Oregon, 
Course of Study, or what may be r^arded aa the promiaeuous 
order suggested by the Los Angeles Course of Study (14). As 
none of these is even approximately the same, it was concluded 
to accept the psychological order auggeated by Dr. Yocum's ex- 
periment and break his groups into smaller ones or combine them 
into larger ones containing each five facts, the idea being that 
one new fact each school day for nine weeks might cover the 
ground in addition. As a result the following groups with their 
reverse forms were selected : 



1 + 1, 


2 + 1, 


3 + 1, 


4 + 1, 


5 + 1 


6 + 1. 


7 + 1. 


8 + 1, 


9 + 1, 


2 + 2 


3 + 2, 


4 + 2, 


5 + 2, 


6 + 2, 


7 + 2 


S + 2. 


9 + 2, 


3 + 3, 


4 + 3, 


5 + 3 


6 + 3, 


7 + 3, 


8 + 3, 


9 + 3, 


4 + 4 


5 + 4, 


6 + 4. 


7 + 4, 


8 + 4, 


9 + 4 


5 + 5. 


6 + 5. 


7 + 5. 


8 + 5, 


■9 + 5 


6 + 6, 


7 + 6. 


8 + 6. 


9 + 6, 


7 + 7 



2. THE MULTIPLICATION COMBINATIONS. 

In multiplication the first nine facta were made tc constitute 
the first group for those who had already had some work in the 
process, i. e., from 1 X 1 to 9 X 1- For those who were begin- 
ning the work for the first time these nine facts were divided 
into two groups, the first of five combinations, the second of four. 
The remaining combinations were divided into groups of five 
facts each, in the same order as shown above for the addition 
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facts, up to the last group, which consisted of only four facta, 
12 X 10, 11 X 11, 12 X 11, 12 X 12. There are thua sixteen 
groups of multiplication facta, it being the idea that this ground 
might be covered in sixteen weeks of five days each, thus giving 
an average of one new fact each day. Experience with this 
manner of grouping, and the definiteneas of the work required 
made it possible to accomplish the tasks in the time allotted ex- 
cept with the class entering school in the fall term. The cor- 
responding class in the spring term, however, had no difficulty in 
keeping up with the schedule. 



6. AIIVANTAOES OF THE QKOUPINO SELECTED. 

The advantages of this manner of grouping are two in num- 
ber: (1) the general idea of the sequence has already been shown 

to be psychological (46), at least as far as the addition facts are 
concerned; and (2) this order following the order of the numeri- 
cal scale does not lay the investigator open to the charge of a 
predetermined attitude of mind toward the problem of relative 
difficulty by a special grouping devised to demonstrate some pos- 
sible theory of his own. 



IX. irtETHOD OF FBOOEDTTRE IN THE FIRST PAKT OF 
THE INVESTIOATION. 

1. PRELIMINARY TESTS. 

The first direct step in the investigation was made at the be- 
ginning of the second term, February 3d, 1913, It consisted in 
giving preliminary tests in addition to the first grade and the 
first half of the second, and in multiplication to the second half 
of the second grade and the third grade. The forty-five addi- 
tion combinations in promiscuous order were arranged in columns 
on a sheet of paper in the following form : 2 -(- 5 ^ , 
3 + 4^ , &c., with the answers omitted as indicated. Simi- 
larly, the seventy-eight multiplication combinations were arranged 
in promiscuous order in three general divisions, representing 
about the first, second and third third's, respectively, of the whole 
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number of facta, the object being to arrange the test to suit in 
some degree the various stages of advancement of the pupils 
tested. The sheets on which the combinations had been mimeo- 
graphed were distributed face down, one on the desk of each 
pupil in the various rooms. The teachers then explained that 
there were a number of little examples in addition or multipli- 
cation, as the case might he, on the sheet, and they wished to 
see how quickly each pupil could write the answers after the 
equal sigu, illustrating on the blackboard just what waa expected. 
The pupils were then told to turn their papers and write. They 
were permitted to write as many answers as they could. This 
test furnished the preliminary test record for each pupil for 
each combination studied until the completion of the drill. The 
same method was pursued at the beginning of the experiment in 
September, 1913, except in the first grade, where the pupils could 
write only with great diificulty, if at all. The results here were 
obtained by oral examination by the teacher. 

This done, each teacher was provided with a list of the groups 
to be taught aa indicated in Section VIII, and a copy of direc- 
tions as follows : 

2. DIRECTIONS TO TEACHERS EOK CONDUCTING DRILLS AKD TESTS. 

The same amount of time and tbe same empbaeis should be uaed each day 
in presenting the groups of combinationB to be taught. The objective demon- 
Htration should be used only tioice, and on Bueceasive days. The presentation 
should consist of ten (10) oral repetitions, three (S) of wbii'h should be In 
concert with the whole body of pupils studying the group, and the other gfcen 
<7) by sections and individuals. There should be fii-e (5) written repetitions 
of each number fact each day. In all of this work of repetition only the correct 
form is to be allowed. 

Subtraction should be taught as the reverse process of addition, and division 
as the reverse process of multiplication. The direct and the reverse procMses 
should go baud in hand. 

The multiplication facts may be taught in the form of tables, but tbey should 
appear in both tbe forma as shown below : 

2x1= 1x2= 

2x2= 2x2= 

2x3= and 3x2 = 

2X4= 4X2= 

2X5= 5X2= 

but all tests should be made promUoiovily, both when oral and when written. 

Teach addition combinations whose sums do not eiceed ten first by the use of 

objects, but only (ictee thus. 

Teach multiplication as sbort-band addition, illustrating by the repetition 
of the same number In column arrangement to be added. 
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Drill afur each written test until at least 97% of class efficiency is obtained, 
then proceed to the next group. 

Review all combinatloDS finiabed twice each day, once oral and once written, 
preterabl; in connection with the problem work. 

Two weeks after giving the final test on each group a review teat on that 
group is to be given along with the daily test on the same sheet o( paper, but 
OD the reverse side, such side to be marked "Review," 

Read over these instructions carefully and tallow them implicitly, as the 
results will be vitiated by an; lack of uniformity in the presentation of the 
materiaL 

3. PEKCEPTION CARDS. 



In order to facilitate the drills and tests and at the same time 
provide an easy means of visual instruction, special perception 
cards for both addition and multiplication were prepared by the 
writer in the form indicated in the following figures: 



Fiff. 1. 



Fig. 2. 



4 + 7 = 11 






7 + 4 = U 




+ 7 


Obverse. 




7 
■ + 4 
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The side represented by Fig. 1 ' was the side used for drill. 
The side represented by Fig. 2 was that used for testing in addi- 
tion. A similar arrangement was used for multiplication. Fig- 
ures 3 and 4 above indicate the disposition of the numbers having 
no reverse form. The reason for the different arrangement of 
the numerals on the obverse and the reverse sides arises out of 
practical considerations. Figures 2 and 4 show the arrangement 
that is usually presented when problems are to be solved, while 
the arrangement shown in Figures 1 and 3 reeommCTids itaelf for 
convenience in printing and in writing results. 

The teachers being already expert in the use of perception 
cards in the teaching of reading became quite as expert in a very 
short time in their use for teaching the combinations of number. 
These cards proved to be important savers of the teachers' time 
and effort as well as effective means of visual instruction. 



4. THE TIME AND METHOD OF TESTING. 

At the beginning of the number period each morning a test 
involving the facta of the group drilled upon the day before was 
given; hence, there was always at least one day's interval be- 
tween the drill and the test upon the group under study. Fre- 
quently, of course, a much longer time elapsed, as when a teat 
came after a single holiday, when there was a two-day interval, 
or when it came on Monday, thus giving a three-day interval, &c. 
For the tests the teacher either wrote the combinations on the 
blackboard, or, which was the usual method, arranged the per- 
ception cards containing the proper combinations in the chalk 
tray of ■the blackboard. The pupils copied these in the order of 
their arrangement and wrote under each the answer. These papers 
were then collected and the results recorded by the teacher. 

a. Objections.— It ia recognized that two objections may be of- 
fered to the written test as a means of gathering data of this kind, 
especially with first grade children: (1) the difficulty that is 
experienced by them on the mere mechanical side of writing 
the symbols is likely to detract from accuracy in the process in- 
volved; and (2) an increased opportimity to obtain answers by 
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"eoimting up" in the case of addition, or "ruiming down" the 
tables in multiplication. On the other hand, it was a matter of 
Dbservation that children learned very quickly to express them- 
selves by means of the written symbol. !For the most part they 
had come into the iirat grade from a kindergarten and reception 
grade where they bad been taught to count, to recognize numbers, 
and to make the symbols on the blackboard. They had also had 
some practice in the nse of the pencil for thia purpose. As to 
"counting up" and "running down" the rows to reach the desired 
point, everything in the method of presentation and the teacher's 
attitude was made to discourage those devices. 

b. Advantages. — The written method has the positive advan- 
tage of being free from the excitement or the stimulus of per- 
sonal contact with the questioner. It may be said to represent 
the calm judgment of the individual tested, just as the written 
productions of mature persons represent a better quality of thought 
and expression than their unprepared oral efforts. But the great- 
est advantage of this method was its adaptability to the purposes 
which it served. It would have been impossible without serious 
interference with the other work of the school for the teacher 
to have given an oral examination to each of her pupils in each 
of the facts of each group apart from the other members of the 
class each day of the week. 

5. EECOEDING RESULTS. 

For recording results a special blank was prepared. This 
blank contained the entire record of a class throughout its work 
on a given group, from the preliminary test to the "review" test, 
two weeks after the last intensive drill. Since positive results 
from the standpoint of teaching were desired, a standard of at 
least 97% class efficiency being the aim in each group, the totals 
and percentages were baaed upon the correct answers in the 
various tests. As the results were all to be subsumed under the 
forty-iive addition and the seventy-eight multiplication combina- 
tions, an error in either the direct or the reverse form or both 
was counted simply as one error, and a "X" was marked in the 
proper place to indicate the same. Correct results were indicated 
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hj a check mark (V). The percentages each day were based 
upon the number of pupila present. By this method the teacher 
had before her each day the standing of the individuals, the 
standing of the combinations themselves, and, in the summary, 
the class accomplishment. It is interesting to note here that after 
the tests were all completed the teachers had found the scheme so 
helpful that many of them requested that they might be allowed 
to continue the use of this record. 



6. NEW GEOUP TESTS. 

When all of the groups of the combinations had been taught 
and the "review" test on the last one had been given, the addi- 
tion combinations were divided into three groups, and a test was 
given on each_of these new groups. After each of such tests was 
given, the five combinations in which errors were moat frequent 
v/ere again taken up for intense drill and dealt with in the 
same manner as originally, under the beading "second time 
over" in the final summary of results If frequent errors ap- 
peared in more than five combinations, then the other com- 
binations in which errors appeared were also given intensive 
drill, and so on until the difficulties had been covered a second 
time, unless the close of the term prevented, as was the case in 
a few instances. 

The multiplication combinations were similarly divided, but 
into five groups. These groups both in addition and multiplica- 
tion contained for the most part both the direct and the reverse 
forms of the number facts. Here again the combinations showing 
most errors were again taken up and drilled intensively. 

Unfortunately the results of those tests were not individualized, 
that is, were not placed in the individual records of the pupils 
taking them. Consequently they could not be included in the 
general summary of results because of the fact that a great num- 
ber of the pupils had to be eliminated from the results in various 
groups owing to absence. The records of the "second time over" 
drills would seem to indicate that most of the errors made in 
these tests must have been made by the pupils thus eliminated. 
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7. FINAI, TESTS, 

At the end of the term final testa in the forty-five addition and 
the seventy-eight multiplication facts were given with the same 
kind of test sheets as were used in the preliminary tests at the 
beginning of the term (See IX, 1), The results of these t«sts 
were tabulated for each pupil and appear for the pupils not elim- 
inated in the final summary sheets (See Table III) under the 
head of 'Tinal Testa." 



X. PSYCHOLOGICAL JUSTIFICATION OF THE METHOD 
OF PRESENTINO THE COMBINATIONS. 

1, THE NUMBER CONCEPT. 

To name things is an inherent tendency of the human mind. 
To represent these names by means of symbols is the next step 
in the natural course of its development^ — a step that may have 
required many centuries to take. No conscious reflection, no 
analysis, no synthesis is necessary to the process of naming. A 
child calls water "maw," as the writer once knew a child to do. 
Aside from the conventions of language, his name for this sub- 
stance was quite as good, and did serve the purposes of his limited 
environment quite as well, as the word in common use. The 
symbol, by which we mean the written symbol, is the product of 
reflection, of analysis, of synthesis. The symbol must of neces- 
sity have some relation, either real or fancied, either to the object 
or to its name, Kumbering differs from naming in that it arises 
not from a perceptive process, which is of one thing or more than 
one as far as numbering goes, but, like the process of developing 
symbols, it arises out of reflection about things. Presumably 
people who have small powers of reflection, such as the savage 
races, will have very few number concepts. And that this is the 
case has already been pointed out by Branford (1), According 
to McLellan and Dewey, "Number is not (psychologically) got 
from thin^, it is put into them" (16). Nor yet is it gotten with- 
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out things. So that to arrive at number concepts without the aid 
of things would be as impossible as to arrive at the concept "Greek 
Education" without the aid of symbola. 



Z. POTTING CONTENT INTO NUMBEE AND PEOCESS SYMBOLH. 

Content is put into symbols of number by showing their rela- 
tion to the concrete things for which the symbols stand, whether 
it be by measuring (1), or by counting (24), or by ratio (34), 
it matters little, adequate number concepts having been obtained 
in all of these ways. Content is put into symbols of process by 
showing with things the relations indicated by such symbols. To 
make clear the content of number and process symbols by the use 
of objects was the object of the two objective presentations of 
each combination within the limits set forth. 



S. OBJECTIVE DEMONSTKATION OF NUMBEH FACTS AND PEOCESSES. 

The number of objective presentations was limited to two. 
This was done to avoid the possibility of forming a habit of de- 
pending upon objects and using the methods of counting to obtain 
results. It was thought that this number of objective presenta- 
tions would be sufficient to demonstrate the meaning and purpose 
of the process involved. On this point Dr. Smith has the follow- 
ing to say: "It is important to use objects freely wherever they 
assist in understanding number relations, but it is equally im- 
portant to abandon them as soon as they have served their pur- 
pose. * * * To continue to use objects after they have ceased 
to be necessary is like always encouraging a child to ride in a 
baby carriage" (32). 

The number of objects used in teaching addition facts was re- 
stricted t« ten for the reason that more than that number tends 
to , confuse and encumber the process rather than to clarify it, 
while the pupil not being able to visualize the larger groups is 
forced into the very method which we strive to avoid — ^the count- 
ing by ones (42). 
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4. MEMOKY AND HABIT, 

The facts of a given group wlien ones developed make some im- 
pression on the mind of the child, but that impression is in- 
sufficient for the purpose of instruction, which is, that each fact 
should become a permanent and instantly available part of his 
mental equipment. The reaction to the abstract stimulus 3 + 4, 

3 
or + 4 should he "7" without the slightest hesitation, just as the 
reaction to m-a-n when seen or spoken is at once "man." To 
obtain this result the laws of memory and habit must be invoked, 
for the correct reactions must not only be memorized but they 
must be made habitual. The most important mechanical factor 
in the production of both these results is repetition (11). There 
must be a great deal of repetition of the combinations in the ab- 
stract, repetition freed from objective paraphernalia in the usual 
sense, but repetition which may make use of various number de- 
vices which lend interest to the exercise. We may be pardoned 
for again quoting Dr. Smith. "It is a serious error," he says, 
"to neglect abstract drill work in arithmetic. So far as scientific 
investigations have shown, pupils who have been trained chiefly 
in concrete problems to the exclusion of the abstract work are 
not so well prepared as those in whose training these two phases 
of arithmetic are fairly balanced. ... At the same time it 
(abstract computation) is the most practical part of arithmetic, 
since most of the numerical problems we meet in life are sim- 
plicity itself as far as the reasoning goes ; they offer difficulties 
only in the mechanical calculations involved, and constantly sug- 
gest to us our slowness and inaccuracy in the abstract work of 
adding, multiplying and the like. In the first grade this work 
is largely but not wholly oral" (33). 

5. ASSOCIATION, jnDOMENT, ETC. 

Memory for facts can, of course, be aided by richness of asso- 
ciation, by judgment, by emotional appeal, and by voluntary at- 
tention. While all of these may and should play some part in 
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memorizing namber ccmbinatione, the opportunities for their use 
for this purpose as compared with similar opportunities presented 
by poetry, or facts of history or geography, &c, are few. On this 
point it is interesting to note Dr. McMurry's observations. He 
says that "advantage should be taken of the similarity between the 
2's, 4's, and S's, also between the 3's, 6'3, and 9's. Xote also the 
fact that in counting by S's the right-hand figure expresses two 
less each time, and in counting by 9's one less. The children are 
interested and curious about these things, and they aid the mem- 
ory. The number 24 equals 4 X 6, 3 X 8, and 2 X 12. Such 
cases should be examined, and reasons given for the variety of 
factors in the same product. 

"In learning the multiplication tables later, the memory can 
be aided by a variety of these re\'iews, comparisons and rational 
analyses, 

"First of all, additions based upon objective work and meas- 
urement stand in the background of thought, as giving meaning to 
multiplications and divisions. Secondly, the repetitions and regu- 
larities running through some of the tables should be studied as 
of curious interest, as in the case of the lO's and S'a, 4'3 and 8's. 
Third, the identity of certain products in different tables, as 
4 X 5 = 20, and 6 X 4 = 20, and 2 X 10 = 20. A comparison 
and analysis of these identities is excellent thought work and a 
positive aid to the memory" (18), All these things are true, but 
they alone cannot be relied upon to give the child that facility in 
the use of the nimiber combinations which will make him adept in 
their promiscuous use, in which form only they will be required 
of him in their practical applications.* 

It was noted in teaching the addition combinations that when 
a double number, as 4 + 4, was mastered it formed a valuable 
connection with 4 + 3, and 4 + 5, tlie former being one less and 
the latter one more than the sum of the double number. This 
principle was also sometimes extended to sums two more or two 
less than the sum of the double number. Then, too, after drill 

'The fact that 56 = 7x8, gives the natural number sequence of B, 6, 7, 8 may 
be helpful, but the poHsibility of error Is still large. The scheme for remem- 
bering the table o( 9's is interesting and should be pointed out to the learner, 
but not relied upon to take the place of necessary drill. 
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there was established a sense of fitness of answer to eombinatioa. 
One day the writer was in a 1— B grade (lower half) when the 
teacher at his suggestion called one of her boys to the desk and 
said, "Herbert, what are 8 and 5 V ■ There was a moment's hesita- 
tion, then came the answer "13." "What were you doing while we 
■were waiting for the answer ?" asked the writer. The reply was, 
"I was thinking over the numbers." This doubtless meant that 
he was going over the number series until he oame to the one that 
"fit" 8 + 5, Professor Thomdyke calls all such combinations 
"paired associates" (37). Given the stimulus 4X7, the neural 
discharge is into "38," just as the stimulus of the German word 
"Gedachtnis," for instance, discharges into "memory" for the 
English student of that language. For a great many of the com- 
binations the possible associations are just as remote as the relation 
between Gedachtnis and memory to one who knows no German, 
while in others the relations are so intricate that to remember the 
relation is more difficult than to commit to memory the combina- 
tion. 

6. REPETITION AND EETENTION. 

Dr. Yocum says, "The dominant factor of any method which 
has for its end maximum certainty and readiness of recall of the 
subject-matter to be taught is repetition" (47). Mr. Speer de- 
clares, "The way to succeed (in memorizing the tables, and he be- 
lieves in taking only a few of the facts of each at a time) is to 
develop vivid mental pictures, and to iix these pictures by bringing 
them again and again before the mind" (35). Dr. W. T. Harris 
went so far as to say that, "Lists of names, * * * also num- 
bers, as, e. f/,, the multiplications, the melting points of minerals, 
&c., must be learaed ■without aid. All indirect means only serve 
to harm here, and are required as self -discovered devices only in 
cjise that interest or attention has been weakened" (6). Dr. Hos- 
enkranz himself declares (and the above opinion of Dr. Harris is 
a comment on his belief), "Tlie means to be used (and these are 
based on the nature of memory itself) are, on the one hand, the 
pronouncing or writing the names or numbers, and, on the other, 
repetition; by the former we gain distinctness, by the latter sure- 
ness of memory" (7). 
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7. EXTENT OF THE APPEAL TO THE SENSES. 

It will be noted that, while repetition is the dominant feature 
of the drill given, this repetition involved as many of the senses 
as possible First, it was made to appeal to the eye in the case of 
objective development, then further to the sense of vision as sym- 
bols by use of number perception cards specially prepared ; second, 
to the motor and auditory senses in the oral drill, then further to 
the visual and motor sense in the written repetitions. Finally, 
teachers were instructed in general talks to make use of the in- 
stincts of play and of rivalry to accomplish results. 



B. SOME EXPEBIMENTS SHOWING THE EJ:SULT8 OF VARYISG MODES 
OP EEPETITION IN THE PHOCESS OF MEMORIZING. 

In this connection it is interesting to note some recent experi- 
ments in committing to memory that have been summarized by 
Miss Elizabeth L. Wood of Clark University (43). Under the 
head of "Methods of Presentation and Learning" she concludes 
that the evident "want of agreement shown in the studies so far 
described" evinces the fact that the problem of whether an audi- 
tory, a visual, a visual-auditory, or a visual-auditory-motor pres- 
entation is "far from solution," Both Pohlman (25) and Meu- 
mann (20) believe "that pupils should be taught to use all sorts 
of presentations though not forced into uneeonomieal methods"' 
(8). Von Sybel (40) in 1909 made experiments of similar im- 
port with 17 adults, students of rank; so also in 1913 Professor 
Henmon (9) of Colorado University reported experiments with 
six of his students from which he deduced the following interest- 
ing conclusions: 

"I. Auditory presentation Is best in almost all cases. 

"II. Visual -auditory presentation is superior to visual alone in 
87^0 of the cases. 

"III. Visual-auditory-motor is inferior to visual-auditory in 
59% of the cases; is inferior to auditory alone in 55% of the 
cases, to visual alone in only 15%. Therefore, a simultaneous 
appeal to several sense departments at once is of no advantage. 
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"IV, The relative value of the diffefent modes of presentation 
remains unchanged for one, two, or three presentations. 

"V, Individual differences in the amount retained was high," 

Thomdyke (38), Kuhlman (12), Segal (30), and Weber (41) 
have also made interesting and important investigations along this 
line. Among these Kuhlman finds, in direct opposition to Hen- 
mon, that the poorest results come from auditory consciousness. 
Segal concluded that every individual should keep to his own type 
of imagery — rather a diffieult pedagogical principle for a class 
room teacher with forty different individuals to teach to put into 
practice, yet •doubtless of much significance after all, if every 
sOch teacher could be an expert psychologist and investigator and 
be able to divide her class into sections, one containing only 
visuelles, another auditives, another motives, &c,, according to the 
individual memory proclivities of the pupils. 

The results of Weber show that retention is in direct rela- 
tion to the nunlber of repetitions, other things being equal. This 
is also in general accord with experiments in committing memory 
gems, made by the writer some years ago, the results of which 
are on file in the Department of Education of the University of 
Pennsylvania (10). Another conclusion of Weber, also espe- 
cially significant in our method of presenting this work, was that 
"it is economical to divide big tasks to be memorized into smaller 
ones, recognized as parts of the whole, but which can be learned 
without exhaustion." 

In the light of these experiments, which unfortunately- were 
carried on with groups too small to make their conclusions more 
than tentative, our method of presenting the combinations cannot 
be objected to on psychological grounds. 

Lest anyone should misunderstand this statement, however, 
and hold that we have violated both pedagogieally and psychologi- 
cally the very principle of practice the necessity of which this 
study seeks to demonstrate in the very first sentence of our "Di- 
rections to Teachers for Conducting the Drills and Tests" 
(IX, 2), we must urge that the validity of our results depended 
upon the rigid adherence to the practice of equal daily emphasis, 
even though it did violate what we know perfectly well to be 
the beet practice in teaching. Without this uniformity of em- 
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phasis, it would have been impossible to judge relative difficulty 
by the results obtained. If just the right emphasis had been put 
upon each combination for its mastery, we should have expected 
just the same number of errors to appear in 4 X 3 as in 8 X 6, if 
errors appeared at all, and relative difficulty would have been 
already worked out in practice, a situation which is contrary to 
fact. So much then had to be sacrificed for the sake of the experi- 
ment. 

XI. DIPPIOULTY. 

1. ITS JIEANINO, 

Since this is a study concerning difficulty, it would seem ad- 
visable to discuss, at least briefly, some of the general charac- 
teristics of the term. It would also seem advisable to discuss it 
in the light of the various phases of our investigation. 

In teaching we impart knowledge ; by stimulating continuous 
use of that knowledge we develop skill. The first three phases 
of our experiment, namely, the determination of relative diffi- 
culty as shown in learning the facts, then as shown by the num- 
ber of errors made, and finally as shown by the comparative num- 
ber of combinations forgotten, we are dealing for the most part 
with knowledge; in the last phase of our investigation, namely, 
the time tests, our principle interest is the measurement of skill. 
We are concerned, in the first place, with relative difficulty from 
the standpoint of acquisition and retention, and, in the second 
place, we note relative difficulty from the standpoint of use. 

Difficulty itself ia a relative term. Existing in a small degree 
it represents facility, or ease of accomplishment. In its, highest 
degree it requires the addition of a modifying word to convey 
its meaning. Then, too, what is difficult for one individual may 
be very easy for another. What is difficult for a given individual 
at a given time or under certain circumstances may be very easy 
at another time or under other circumstances. Any experiment, 
therefore, which seeks to determine relative difficulty must clearly 
set forth, as we have sought to do in this, the details indicated 
by the following questions: difficult for whom, at what age and 
grade, and under what method of instruction? 
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As has already been pointed out, memory for facts is as- 
sisted by richness of association, use of judgment, &c. If there 
are combisations around which the associations are few or remote, 
as in the case of 8 + 5 = 13, or 9 X 7 = 63, where the i 
in the answer are all different from those in the combination. 
Professor Doring not«s (2) ; if their nature is such as to make 
difficult the use of judgment, as in the ease of 8 + 6 ^ 14, or 
8 X 12^=96, where the very bigness of the results is on or be- 
yond the borderland of the comprehension of the pupil, we may 
expect difficulty in acquisition and in retention, and slowness and 
inaccuracy in use. If, on the other hand, the associations are many 
and easy, occurring in the child's daily activities, as in the value 
of coins, in the purchase of rolls from the baker, or bananas, or 
pieces of candy from the shop-keeper, in the playing of marbles or 
dominoes, &c. ; if the answers contain numbers which occur in 
the combinations, as 7 X 5 ^ 35, or 8 X 6 ^ 48 ; if the judg- 
ments are easy, as 5 + 5 :^ 10, then 5 -f- 6 ^^^ H > if the answers 
are well within the experience or easy comprehension of the child 
— in all these cases we may expect little difBculty either in acquisi- 
tion or retention, and we may look for a high degree of skill and 
accuracy in the use of the combinations. 



3. ITS ME AS DEE. 

As the acquisition of knowledge means, psychologically, the 
formation of new "brain paths," as Professor James expresses it, 
difficulty might be expressed in terms of neural resistance — in 
mental "ohms," as it were. Aside from the physiological condi- 
tion of increased blood supply to the brain during the process of 
special activity of that organ, we do not know enough of the nature 
of its functioning to measure that functioning in comprehensible 
terms. We must content ourselves at present by trying to measure 
it in terms of its external phenomena, as we measure that mys- 
terious force called electricity. How do we determine that an 
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activity is difficult ? In the first place, other things being equal, 
by the time it takes to learn to perform it with precision. Writ- 
ing is a difficult art for the child to acquire. Months, perhaps 
years, of practice are necessary to develop freedom and skill in its 
nse. In the next place, we determine difficnlty by the persistence 
of error in the course of mastery. How many false notes are 
struck in the process of learning the scales; bow many are made 
too long or too short, in learning to play a musical instrument? 
The smaller the chance for error, the less difficult the process. It 
is, therefore, less difficult to learn the piano than the pipe organ. 
One-step problems in arithmetic are less difficult than two or three- 
step problems. 

We should, therefore, evaluate our data in the first experiment 
by correlating the time required to reach the results obtained 
with the number of errors made in tbe process. In attempting to 
do this we found that the time given to each of the groups was not 
a true index of difficulty, because, for the sake of class efficiency, 
the drills had to be prolonged beyond the time necessary to secure 
efficiency with those who were not eliminated on account of absence 
from some necessary part of the work. The girls had sometimes 
to "mark time" while the boys were catching up. In the last ex- 
periment, however, as time was the only element considered, only 
correct results being counted, we may be justified in using it as a 
true index of difficulty as far as a comparison of the groups of 
facts indicated is concerned. 

The factor of time having, in a measure, been eliminated by 
force of circumstances in the evaluation of the results of the firet 
experiment, we have laid down as fundamental the following two 
methods of evaluation: (1) In the process of learning the com- 
binations, (he co-efficient of difficulty is ike raiio of the mimier of 
errors made in the process to the mimber of errors overcome, as 
shown by a comparison of the number of errors made in the pre- 
liminary test with the number of errors made in the final test in 
each combvnaiion, (md reduced, for the purpose of comparison, to 
a basis of 50 or 100 pupils. In calculating co-efficients from this 
point of view, errors in the review tests were counted the same as 
errors in the course of instruction. (2) The co-effidenis of difficulty 
by the second method of evaluation are determined by dividing the 
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grand iotal of errors made in each combination: by the number of 
pnpils involved. This method gives as the co-effieieiit of difficulty 
the average number of errors for each pupil. The method is based 
upon the following reasoning: the presence of error in the pre- 
liminary teat is an indication of difficulty — the difficulty to be 
ovei-eome; the presence of error in the process of instruction is 
an indication of difficulty — the difficulty of mastery ; the presence 
of error in the review and in the final test is an indicjition of diffi- 
culty—the difficulty of retention ; hence the total of these errors 
would seem to indicate the entire difficulty presented J)y the com- 
bination. We have considered both of these methods of such value 
as to be worthy of record and have given the results of each side by 
side in Table VI. 

In the second and third experiments we have worked on the as- 
smnption that the number of errors made in the tests is in direct 
proportion to the difficulty, and have arranged the results in these 
experiments accordingly. Difficulty then is to be measured by the 
"method of errors" in the first three parts of our investigation, and 
by the "method of time" in the last part of the investigation. 



Xn. RESULTS IN THE STUDY OF ADDITION. 

1. EESULTS ITf TEACHING THE FOETY-FIVE ADDITION 
COMBINATIONS. 

To give ■ in full the tabulation for all the classes for all the 
days for all of the combinations would require more space than 
is at the disposition of the vrriter. Those who may be interested 
may have access t* the complete records by applying to the De- 
partment of Education of the University of Pennsylvania. How- 
ever, in order to show the method pursued, the data tabulated 
for the study of 8 M- ^ is given below as typical. 
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The same kiud of a study was made of each of the forty-five 
addition facts, an entire summary of which, tabulated to show 
co-efficienta of difBenlty from the two jwints of view as set forth 
on page 38, is shown below : 

TABLE IV.— PART I. 
SUUMABY OF RESULTS IN TEACHIKG ADDITION. 
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TABLE IV.— PART I.— Co«tinaeil. 

RESULTS IN TEACHING ADDlTIO.f. 



9+8. 
©+9 



•00.920 
7 3.491 

12 2.421 
«2.182 



51.271 

91.471 
4 2.602 

91.842 



81.421 
71.70 2 
4 2.10 2 



;6 1.310 
» 3.04 2 

151.341 



141.561 
Sl.OOO 



Note. — a and a', number of boys and glrla, rpapectively ; b and b', numbei 
rors made by boys and Elrle, respectively. In the preliminary test; c and c 
l>er of errors made in Icarnini; ; d and d>. number of errors In final test ; e 
(S — d) number o( errors overcome: f and f, eo-efBdents of difflcultj (c -?■ 
and s\ co-efflclentB of dltBcalty for 50 boj-a or SO girls (SOf -r a) ; h and b 
- -"" of difficulty (b + c + dl -7- a. 
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TABLE IV.— PART II. 



A 


B 


C 


D 


E 


F 




105 


18 


75 


3 


15 


5.00 




105 


46 


104 


9 


37 


2.81 




105 


50 


102 


4 


46 


2.22 








96 


9 


42 


2.28 




105 


48 


102 


6 


42 


2.43 




113 


47 


TO 


6 


41 


1.68 




113 


46 


69 


7 


39 


1.77 




113 


49 


68 




44 


1.55 




113 


52 


80 


8 


44 


1.82 




113 


« 


86 


5 


37 


2.32 




124 


59 


105 


7 


52 


2.02 




124 


62 


108 


9 


63 


2.04 




124 


51 


120 




44 


2.53 




124 


55 


115 


9 


46 


2.50 




.124 


76 


120 


14 


62 


1.94 




111 


40 


61 


3 


32 


1.90 




111 


52 


68 


lU 


42 


1.62 




111 


48 


47 


9 


39 


1.20 








82 


14 


31 


2.64 




111 


50 


34 


14 


36 


2.33 










15 


37 


l.&l 




109 


56 


65 


12 


44 


1.48 








68 


14 


43 


1.58 




109 


49 


81 


12 


37 


2.19 




109 


32 


44 


5 


27 


1.63 




110 


52 


77 


10 


42 


1.83 




110 


54 


92 


13 


41 


2.24 




110 


52 


80 


12 


40 


2.00 




110 


54 


79 


18 


36 


2.19 




110 


67 


92 


17 


50 


1.84 




113 


34 


24 


5 


29 


0.83 




113 


56 


51 


15 


41 


1.34 




113 


64 


71 


18 


46 


1.54 




113 


58 


69 


20 


38 


1.81 




113 


64 


57 


19 


45 


1.27 




99 


41 


37 


8 


33 


1.12 










16 


32 


2.40 




99 


57 


90 


22 


35 


2.57 




99 


65 


101 


18 


47 


2.15 








49 


10 


42 


1.17 




123 




143 


28 




2.07 




123 


87 


171 


25 


62 


2.76 




123 


79 


74 


14 


65 


1.14 




123 


86 


138 


24 


62 


2.22 




123 


80 


82 


10 


70 


1.17 





0.91 
1.51 
1.49 



1.18 
1.41 
1.43 



1.50 
1.61 

2.04 
1.82 



0.87 
1.42 
1.71 



1.12 
2.05 
2.30 



t boltom of Table IV,— Part I 
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or BESULTS. 

a. Interpretation of Table IV. — In the summary of Table III, 
shown in this table, it will be noted that the number o£ pupils 
varies for nearly every new group of facts presented. This is due 
to the elimination of piipils on account of absence. In order 
to be counted in the work a pupil must have taken the prelim- 
inary test, the review test, and the final test at the end of the 
term. Besides this he must not have been absent more than one 
day in every five days of intensive drill. As a result of these re- 
quirements at least 25% of the pupils who took part in the ex- 
periment had to be eliminated at one time or another in making 
up the results for the various groups. 

Owing to this varying number it became necessary to reduce 
re8ults_to a common basis to facilitate comparison. It would be 
all right to compare with each other the co-efficients of difficulty 
obtained for boys for the first five combinations, for in each 
case there were 57 boys involved, but to compare the same with 
group three where there are 61 boys is unfair, as is shown hy 
the following figures : the co-efficient of 4 + 1 in column "f " 
is 2.12 for 57 boys, that of 4 + 2 in the same column is 2.11 for 
61 boys. A comparison here would indicate a difference of only 
.01, but when these figures are to be reduced to a basis of 50 boys 
each, as shown in column "g," the first co-efficient becomes 1.86 
and the second 1.73, a difference of .13. The values in columns 
"f," "f," and "F" were at first reduced to a basis of one pupil. 
This, however, gave such a very small quantity that it was thought 
best to make the common basis a round number near in value to 
average number of pupils involved, so 50 was selected for the 
multiple of "f" and "f ," and this required the multiple of "F" 
to be 100. 

In this table the co-efficients shown in columns "g," "g^," and 
"G" are those used for comparison for boys, girls, and the average 
for both boys and girls, while columns "h," "h*," and "H" show 
in the same manner what we prefer to call the "Total Errors 
Co-efficient" for boys, girls, and the average for both boys and 
girls respectively. 
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6. Method of Studying the Graphs. — The values of the columns 
headed "g" and "g^" (Table IV) are shown by the ordinate 
values of Graph I, In the study of the graphs in this part 
of the experiment we must always bear in mind that the co-effi- 
cients of difficulty found are co-efficients of difficulty in the process 
of learning the combinations in the order of their presentation. 
Let us take the three facta, 5 + 1, 4 + 3, and 8 + 4 for boys. 
It wiU appear that for each of these the co-efficient of difficulty 
is 2. We cannot reason from that that if these three facts were 
brought together they could he taught de novo with the same ease, 
but it does mean that the 5 + 1 fact at the time of its presenta- 
tion offered the same degree of difficulty as the 4 + 3 'and the 
8 + 4 facts did at the time they were presented. If a line were 
drawn through the average heights of the ordinates in Graph I 
from left to right, its trend would be generally downward in- 
stead of upward as one might suppose. This demonstrates statis- 
tically in the study of numbers what everybody, even those who 
no longer believe in the doctrine of formal discipline, recognizes 
to be true, viz., that one of the results, one of the bi-products, of 
accomplishment in any field of endeavor is power — power to 
overcome with greater ease other difficulties in the same or in 
related fields of endeavor. 

c. Analysis and Significance of the Graphs. — A further analysis 
of Graph I shows that in 14 out of the 45 cases the "curves" for 
boys and girls tend in opposite directions as in the case of 5 + 3, 
for instance. In one case, 8 + 5, the "curve" for girls is horizon- 
tal while for boys it tends strongly upward. In 30 cases, there- 
fore, while the values for boys and girls differ materially,- the 
tendencies are in the same direction as compared with the co- 
efficients of the combinations immediately preceding. The aver- 
age of the co-efficients for boys is 1.89 while that for the girls is 
1.82. This would indicate that the girls learned the combina- 
tions with slightly less difficulty than the boys, and this notwith- 
standing their inordinately large co-efficient for learning 1 + 1. 
Had the co-efficient for 1 + 1 been the same for both boys and 
girls, the difference between the averages of their respective co- 
efficients of difficulty would have been .18 instead of .07, or would 
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have shown that girls learn the combinations with about 10% 
less difficulty than boys of the same age and grade. 

The high eo-effieient of difficulty for 1 -}- 1 for the girls ia due 
to the fact that only six errors were made by the 48 girls in 
this combination in the preliminary testa, the possibilities for im- 
provement were, therefore, correspondingly leas. If no errors, 
instead of two, had occurred in the final test, the co-efflcient 
would then have been 5.91. Both of these figures demonstrate 
the necessity of studying the co-efficients here represented in 
connection with those shown in Graph II. 

A glance at Graph II, which shows the total errors co-effi- 
cients of difficulty, calculated on the basis of the entire number 
of errors made by boys and girls in all of the tests, shows that the 
girls have a smaller average eo-efficient than the boys, the aver- 
age in this case being 1.41 for boys and 1.26 for girls, or about 
10% less. This graph shows a very close similarity between the 
"curve" for boys and that for girls, the fewer errors appearing 
in the double numbers being especially significant for both. 

We have no doubt that a part of the difficulty represented in the 
first group was due to the mechanical difficulty of writing the 
numbers required by the tests, though, as haa already been ex- 
plained, most of the 1-B children had had the writing of num- 
bers in their work in the reception grade. This difficulty, how- 
ever, would be at its maximum in September and applies to only 
about one-fourth of the pupils whose records are given. 

In order to obtain the best results in the study of Graphs I 
and II, it is best to study them by groups of five combinations 
each, that is, in the manner in which the wort was given. It 
is readily seen that the learning of the first group (1 + 1 to 
1 + 5) carried over to make the second group (6 + 1 to 9 + 1) 
easier; but the fact 2 + 2 of this group represented a new order 
of things, consequently a new difficulty. With these gi-aphs be- 
fore her and an occasional check upon the results of her teach- 
ing, the primary teacher should be able to attack with some con- 
fidence the teaching of the elementary combinations in addition. 
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Xm. RESULTS IN THE STUDY OF MULTIPLICATION. 



1. RESULTS IN TEACHING THE SEVENTY-EIGHT MULTIPLICATION 
COMBINATIONS. 

Tor the sake of brevity, a& in the case of the reaults of the 
study of addition, we give the detail of but one (8 X ^) of the 
seventy-eight combinations studied. This will serve to demon- 
strate the method of tabulating the results for all. The complete 
record may be had by applying to the Department of Education 
of the University of Pennsylvania. 
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From the full records, of which Table V is a sample, the data as 
shown in Table VI below were obtained. This table represents 
the tabulation of nearly 13,000 errors, and is worked out on ex- 
actly the same principles as Table IV in addition, and, therefore, 
needs no special comment as to its meaning. 



TABLE VI.— PART I. 

« TBIACHIKO MULTIPLICATION. 



a 


b 




81 


21 


8 


108 


46 




08 


45 




97 


35 


54 


»7 


28 


23 


97 


32 


50 


97 


47 


23 


95 


40 


91 


95 


52 


126 


95 


62 


130 


qo 


29 


15 


99 


55 


54 


99 


33 


14 


101 


46 


51 


101 


34 


14 


to 


60 


31 


1=^ 


5( 


30 


95 




101 


95 


« 


98 


95 


77 


111 


9^ 


4" 


10 


OS 


54 


23 


98 


72 


67 



•1 

1.8911.10 
2.I2I1.1 
4.56J4.22 
5.4015.56 
ill. 12 
4.55]4.r- 



101 23 

28| " 



25 47 



0.62 



■4| 371 14 

8111121 37 44 

8411841 43 414.49 

471 16| 5 42 

52| 31 1 8 44 



6|102| : 
• Thlrti foir of tbe BmallPi 



50.98 

7 2.602.13 

2 2.14 
83.432.44 
9 0.3010, 

8 0.4910.85 
31.461.6T 



.19 



2.82|2.. 
5.1013.! 

0.4.310.77 
0.80|1.03 
12.28| 

ablnntlons 



0.74 
1.19 
0.67 
0.96 



1.09 

2.15 
2.29 
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TABLE VI.— PART I.—Continaed. 

SUMMARY OF RESULTS IN TBACHIKO MULTIPUCATION. * 



11X9... 
12 

10 

11X10.. 
12 

11X11.. 

12 : 

12X12.. |1 

NOTK. — For e 
g' = lOM o " ' 



91.74 
19 0.41 
il 0.41 
i81.03 

i7 0.81 
^0.43 

18 0.50 

19 0.97 

14 0.30 
110.93 
iOl.ie 

191.07 



1.71 
0.40 
0.40 
1.01 

0.791 
0.410 
0.47 
0.911 

0.37 

0.881 
1.161 

1.071 



2.10 
0.81 
0.80 
1.61 



8 2.12 

01.37 



0.73 
3 0.15 

10.10 



l.Sfl 
0.66 
0.71 



01.421.80 
13 0.461.14 
t end of Table IT., but here g and 
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TABLE VI.— PART II. 
TOIAUI FOB BOrS AND filBLS. 



A 


B 


C 


D 


E 


P 


G 


141 


39 


,6 


16 


23 


0.70 


0.98 


183 


75 


85 


28 


47 


1.81 


2.66 


183 


84 


117 


39 


45 


2.60 


2.84 


167 


66 


102 


34 


31 


3.2» 


3.94 


ler 




42 




38 


1.10 


1.32 


ler 


63 


87 


29 


34 


2.56 


3.07 


167 


81 


42 


22 


59 


0.71 


0.85 


159 


99 


1.S7 


33 


66 


2.45 


3.08 


159 


85 


184 


37 


48 


3.83 


4.81 


159 


103 


197 


49 


54 


3.65 


4.58 


175 


59 


26 


9 


60 


0.52 


0.59 


175 


101 


91 


37 


64 


1.42 


1.62 


175 


71 


28 


14 


67 


0.40 


0.56 


173 


94 


82 


35 


59 


1.39 


1.61 


173 


67 


28 


4 


63 


0.44 


0.51 


172 


106 


60 


32 


74 


0.68 


0.78 


172 


95 


49 


33 


62 


0.79 


0.92 


172 


123 


180 


35 




2.05 


2,38 


172 


128 


173 


53 


73 


2.37 


2.76 


172 




205 


63 


71 


2.89 


3.36 


172 


81 


14 


11 


70 


0.20 


0.23 


172 


96 


36 


10 


86 


0.42 




172 


130 


113 


35 


96 


1.19 


1.38 


172 


121 


58 


23 


98 


0.59 


0.79 


172 


142 


204 


63 


89 


2.29 


2.66 


157 


145 


260 


64 


81 


8.21 


4.09 




85 


24 




79 


0.30 




157 


88 


43 


12 


76 


0.57 


0.73 


157 


119 


167 


43 


76 


2.07 


2.64 






147 


36 


76 


1.93 


2.46 


177 


154 


L34 


46 


109 


1.23 




177 




21 


16 


72 


0.29 




177 


101 


25 


9 


91 


0.27 


0.31 


177 


145 


106 


33 


112 


0.95 


1.07 








,7 


160 


0.59 


0.69 


180 


91 


26 


IT 


74 


0.35 






99 


38 


15 


84 


0.45 


0.60 


180 


151 


«0 


40 


111 


0.81 




180 


87 


24 


10 


77 


0.31 


0.34 


ISO 


148 




34 


14 


0.B7 


0.63 


174 


136 


98 


36 


100 


0.98 


1.11 
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TABLE VI.— PART II.— Conlinued. 





A 


B 


C 


D 


E 


F 


G 


H 


Uxll 

12 


174 
174 


149 
158 


112 
154 


28 
S3 


121 

125 


0.93 
1.24 


LOT 
1.42 


1.66 
1.98 


12x12.... 


■ 174 


138 


62 


21 


107 


0.58 


0.67 


1.27 



ot errors In prcllmlaarv tEsts ; C, Qum- 
; I), Dumber of errors la final teata : E 
errors ofercomt; t' <C -:- E), co-efflclente of dffflculty for 
' -i- A}, average co-efflcients at dllBciilt;, See g and g' of tbla 

, total errors co-efficients of dltBculty. 
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5. DISCUSSION OF TltE EESCLTS IN MULTIPLICATION. 

The number, age, sex, and class distribution of the pupils as 
shown in Table V represent the conditions in regard to these 
factors which obtained throughout the entire study. The experi- 
ment ran through two tenns of five months each, beginning in Feb- 
ruary and ending the following Februarj-. Hence, the conditions 
of the whole school year, such as vacations, holidays, promotions, 
&c., are all involved and argue for the validity of the results under 
circumstances that are practically duplicated from year to year in 
an;- smpll system of schools. 

The variation in the number of pupils recorded in each group of 
combinations studied is due to the same process of elimination for 
absence as was described in the discussion of the addition results 
(XIT5, a). 

All results in multiplication are reduced to the same base to 
facilitate comparison, and the same method of evaluation, or de- 
tennining co-efficients of difficulty used in addition is again used 
for the multiplication (XII 5, a). 

It must be borne in mind, as in the case of the addition graphs, 
that the results as shown by Graph's III and IV are of value only 
when the combinations are studied in the order of the group pre- 
sentations — that is, progressively from group one to group sixteen; 
The order of the combinations in each group was always pro- 
miscuous. By this method of study it will be noted how, for in- 
stance, the effect of learning gronp one (1 X 1 to 5 X 1) is shown 
in learning the other combinations with 1, and how the general 
trend of difficulty at first upward soon begins to go downward and 
so continues as the size of the numbers increase. The "curves" 
show very clearly the peaks of difficulty and the depressions indica- 
tive of the lack of difficulty, in fact, a study of the graphs tells the 
whole story. 

A further analysis of Graph III shows that in 15 out of the 78 
cases the lines of the "curve" tend in opposite directions for hoys 
and girls. Therefore, in 63 cases the trend of difficulty for Iwys 
and for girls is in the same direction, if not to the same values. A 
casnalglance at this graph will show that the girls had less diffi- 
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culty in learning the multiplication combination& than the boys. 
If we calculate the averages of their reepective co-efficients of diffi- 
culty, we fine that the average for boye is 1.61, while that for girla 
is only 1.18, or nearly 27% less. In other words, the girls learned 
the multiplication facts more readily than the boys by over a 
fourth. 

Graph IV", showing the total errors co-efficients for boys and 
girls, presents a very interesting similarity of tendency for the two 
sexes. In this all the errors made in the course of the experiment 
are included. Here, again, we note an advantage in favor of the 
girls. A calculation of the average of the co-efficients of difficulty 
from columns in Table VI marked "h" and "h"' gives for the 
boys 1.035, and for the girls ,91, This shows that the girls made 
about 13% fewer errors throughout the drills than the boys. 

These multiplication graphs should be of much assistance to the 
primary teacher who is confronted with the problem of teaching 
the multiplication facts. Aside from what they show of relative 
difficulty on their face, they should warn the teacher against an 
attempt to get along too rapidly in the early stages of the process. 
She should remember that here is the period for tbe development 
of power which is to serve her pupils ^vell in their stru^les with 
the lai^r numbers to come. 



XIV. RELATIVE DIPPICULTy AS INDICATED BY 
ERRORS ALONE. 

1. PLAN, 

It was not deemed sufficient to study this problem from the two 
points of view only that have tbus far been set forth. These have 
their value to the teacher in the process of teachmg the combina- 
tions. It was also thought advisable to consider the problem that 
is presented to the teacher after the ground has been gone over, to 
point out to her the places where the tares of forgetfulness are most 
likely to have sprung up and to have choked out the newly planted 
memories. Throng the kindness and co-operation of the Super- 
intendent, Principals, and Third and Fourth Grade Teachers of 
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one of the large city systems of schools m New Jersey, the writer 
was able to get results from the examination of a much larger 
number of pupils than the foregoing experiments involved. 

The plan was to give each third grade pnpil in the city a written 
teet, first, in the forty- five addition facts, and immediately there- 
after, a test in the seventy -eight multiplication combinations. 
These tests were given during the last week of school preceding the 
summer vacation. It should be added here that the course of study 
in arithmetic provided for the teaching of all the tables to 12 X. 12 
by the end of the third year. The plan also proposed exactly the 
same tests to be given to the pupils of the fourth grade during the 
first week of school in September. This grade was, of course, se- 
lected with the idea of catching a maximum number of those who 
were tested in June and comparing the results of the two tests. 
This comparison would show the combinations most likely to be 
foi^tten and thus provide the fourth grade teacher with a most 
valuable guide in directing the work of her number reviews. 



2. NATURE OF THE TESTS, 

With these ends in view tests in the forty-five facts of addition, 
promiscuously arranged, were given to 1,056 pupils, as indicated 
in Table VII, which shows the number of errors in the various 
combinations and the percentage of such errors. Table VIII 
shows the arrangement of these facts in the order of their difficulty, 
based upon the number of errors made in eadi. 

The seventy-eight multiplication combinations, arranged pro- 
miscuously in exactly the same way as for the preliminary and 
final tests given in the first part of this investigation, were given 
to 1,215 pupils, as indicated in Tables IX and X. 

The combinations, both in addition and multiplication, were 
typewritten and mimeographed. The directions to teachers which 
follow will explain more fully the nature of the tests, as well as 
explain the methods pursued in giving them. 
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TABLE VII. 



8H0WING THB NTJUBEB <1 



( THE ADDITION C0MBinATI0II9 BT 





Boyt. 


OirU. 


^« 


11 


Grade 


3 


4 


1&2 


Totals. 


3 


4 


1&2 


Totals. 


11 




No. Pupils... 


332 


115 


55 


602 


338 


112 


54 


554 


1066 





1 


8 
3 
5 
6 
5 
4 
3 

3 
5 
7 
5 
3 
6 

2 

I 

3 

8 
10 
14 

3 
5 
8 
14 
13 
14 

4 
10 
10 
19 
15 

10 
13 
17 
16 


1 

:::. 

1 

1 

.... 

' i 
— 

2 
2 
4 
2 
3 
4 
3 

3 
1 

3 
3 
6 
5 

I 

11 
11 

* 

1 
6 
8 
8 


1 

2 

\ 

2 
2 
3 
8 
4 

1 
3 
3 

4 
2 

1 
1 

1 
2 
3 
2 
6 
8 
4 

3 

4 
5 
6 
5 

3 

» 
5 

7 

1 
5 
11 

7 


.5 

i 

12 

s 

6 
6 

i 

24 

.1 
30 
:»5 

26 

12 
24 
36 

31 


8 
6 
6 
T 

7 
6 
8 
7 

2 

4 

6 
3 
4 
8 
9 
3 
6 

2 
8 
7 
5 

10 
7 

14 


2 

■"2 

1 
1 
3 
3 


1 
1 
2 
1 

i 


11 
7 

10 
9 
8 
9 

12 
7 
6 

4 

8 
6 
7 
12 
15 
9 
12 

3 

14 
13 

20 
19 

22 

2 
11 
19 

26 
12 
27 

4 
14 

26 
33 

23 

8 
26 
30 
51 


17 
21 
19 
15 
15 
17 
20 
19 
13 

9 
17 
16 
13 
19 
24 
12 
15 

8 
18 
26 
■ 20 
37 
41 
43 

8 
20 
34 

48 
37 

51 

9 
32 

56 

49 

20 
50 
66 

82 






2.0 




1 R 






5+1 


1.4 




1 9 




1.8 




3 


1 


1.2 








1 

"i 
3 

"3 

1 

' i 

■ 2 

4 

7 

5 


1 
3 
3 
3 
3 
1 
3 

i 

6 
6 
6 

,5 
3 

I 

4 
3 
3 
5 

3 
7 
8 
6 
3 

2 
6 

7 
5 








5+2 


1.2 




2.3 








1.4 




0.7 










6+3 


1.9 




3 9 








0.7 




S 
10 
19 

4 
17 

1 
7 
11 
23 
13 

5 

16 

14 

22 


1 
5 
4 
5 
5 

.... 

6 
4 

7 

1 

4 
9 
14 


1.9 


6+4 


3.2 




3,n 












3.0 


7+5 


5.3 
6.4 




4,« 




1.9 


7+6 


4.7 
6.2 




7.8 



ivGooi^lc 



TABLE VII.— Coniinued. 



SHOWING THE NUUDEB Q 



[ ADDITION COMBINATIONS I 





Boga. 


Oirli. 




1' 


II 

fi-s 


Grade 


3 


4 [142 


Totals. 


3 4 j 1&2 


Totals. 


No. PupUs... 


33J 


Hi! 


d 


J 


338 


112 5^ 


S5^ 


1066 






8 
18 
29 

13 
30 

S 


2 

i 

3 
12 

4 


i 

4 

14 
6 


14 
34 
45 

20 
S6 

15 


5 
19 
27 

12 
28 

7 


1 

7 9 

8 10 

2 3 
6 11 

2 s 


e 

35 
45 

17 
39 

14 


20 

9e 

29 




8+7 


6.5 


S+8 


3.5 


9+9 


2.7 



The average number of errors made by each boy was 1.45 ; that 
for each girl 1.29. Here, again, we have a difference in favor of 
the girls, this time of 11%, A further comparison of the number 
of errors made by boys and girls, while not specially significant, 
shows a few points of interest. 8+4, with 25 errors, seemed to 
be much more difficult for the boys than for the girls, who made 
only 12 errors, while 9 + 6, with only 31 errors, seemed to be 
much easier for the boys than for the girls, who made 51 errors. 
9 + 8, on the other hand, with 56 errors, seemed to be more diffi- 
cult for the boys than for 'the girls, who made only 39 errors in 
this combination. In all the cases, however, the percentages of 
error differ but slightly. 
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TABLE VIII. 



SItOWINO OBDEB C 



I HUUBEB OF BBBOBS 



Combinat 


(6) 

(1) 

(3) 

(8) 

(2) 

(omitted) 
<10) .... 
(omitted) 
(15) .... 

(5) 

(13) .... 

w 

<14) .... 
(12) .... 

(7) 

(11) .... 
(omitted) 

(8) 


No. Errors. 
... 95 
... 90 

... 82 

'.'.'. 68 
... 66 
... 56 
... 51 
... 50 
... 49 
... 48 
... 43 
... 41 
... 37 
... 3T 
... 37 
... 34 
... 32 


Combination. 


No. ErrotB. 


8 + 7 

9 + 6 


6 + 6 


20 








8 + 5 






8 + 6 


6 + 2 


19 


9 + 4 


3 + 1 


19 


9 + 5 


3 + 2 


17 














8 + S 


9 + 2 


15 






















8 + 2 






































3 + 3 


8 



eomblDatloDi ai 

1. Discussion, — In the above table it is intereating to note that 
the first 16 combinations in which errors are most frequent have 
each in them either a 9 or an 8 or a 7, the S's appearing in the 
greatest number of cases, the 9*8 next, but in only 3 fewer eases, 
and the T's next (cf. III. 1). It is also significant that the last 
four combinations on the list are doubles. That 1 + 1 stands so 
high in the number of errors appearing therein is rather startling, 
especially in the light of the fact that "1 + 1 ^ 1" was regarded 
as an error in "procees" and not counted in this table. It is also 
interesting to observe the combinations which the same number of 
errors brings together; for example, 8+8, 8+4, 7+3; 7+7, 
6 + 6, 6 + 4, 6 + 3, 7 + 1, &c 

In order to show the relation of the number of errore in "pro- 
cess" to the number of other errors, records were kept for 720 
third grade children as shown by the following table: 
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Combination. 


P 


O 


Combinatiou. 


P 







28 
39 
41 
42 

38 
40 

40 

40 

■ 28 
47 
51 
72 

56 • 

&i 

52 

59 

70 
54 
63 

52 

48 
52 


12 
18 
14 

12 
12 
13 
11 
5 

7 
11 
10 

9 
11 
13 

8 

8 

4 
13 

18 
17 
28 




57 
57 
54 
50 
40 
39 

41 
56 
46 

53 
33 

45 
36 

45 
32 

35 
35 
33 

26 
27 

31 
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5 





























Discussion.— The large number of errors in process is doubtless 
dwo to the fact that tlie emphasis of the year's te.".chirig had been 
upon the multiplication tables an<l not upon the addition facts. 
Tt might be argned that the total number of errors made in a given 
eombination, counting both errors in process and other errors, gives 
a truer index of relative difficulty than the "other on-ors" as above 
used. In answer to this it will be observed that errors in process 
are generally most frequent when the multiplication of the num- 
ber involved 19 easiest, and that these errors decrease as the diffi- 
culty in multiplication increases. The total of both errors in pro- 
cess and "other errors" would make 4 -)- 2 and 4 -|- 3 the most 
difficult of all the facts, ■which is manifestly not the ease. 
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It may be wondered how an error in process was counted for 
2 + 2, in which the sum and the product are the same. This 
combination appeared in the group 7 + 9, 2 + 3, 3 + 1. If the 
first and last answers of the group were obtained by multiplication, 
it was presumed that the middle one was also multiplied instead of 
added. 

Discussion. — The summary of results thus far obtained in addi- 
ion is shown in the graphic r^resentation (Graph V). Of 
hese "curves," two should be especially helpful to the primary 
reacher: (1) the one giving the average co-eiBcients of difficulty 
:or learning the combinations for both boys and girls; and (2) 
hat showing the percentage of errors made iy children. The 
"ormer should indicate to the teacher the easy and the hard places 
as she proceeds in teaching the forty-five facts, while the latter 
shows the main points of attack in conducting review exercises 
with children who have presumably once learned the facts. 
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TABLE K.—ConHnved. 



THE NUUBEB OF E 



( UULTIPIJCATION COMBINATIONS I 













1,215 c 


Hm 


BEB 














Boyi. 


OirJt. 


,^ 


n^ 


Grade .... 


.., 


2&3 


5« 


Totals. 


^ 


3 


2&3 


6&3 


Totals. 


ii 


1? 


Nn. Pupils 


133 


334 


61 


58 


586 


135 


304 


42 


58 


629 


1215 




9 

10X9 

11 

12 

11x10.... 

lIXll.... 

12 

12x12.... 


1 

25 
79 
61 

S 

48 


62 

It 
101 

61 
170 

119 


4 
2 
3 
5 

11 


22 

7 
12 

29 

6 
32 

28 

3= 

40 

23 


122 
39 

82 
192 

94 

292 
230 

351 
305 

191 


43 
11 
25 

50 

■g 

67 

85 
83 

56 


74 
40 
61 
143 

24< 


I 

4 

i 


18 
3 
11 

28 

8 
32 
30 

15 


141 

.■55 
99 
225 

147 
346 
312 

384 
350 

234 


263 21.6 
94 7.7 
18114.9 
41734.4 

24119.8 
63852.5 
542 44.6 

735 60.5 
655.54.0 

42535.0 



• Bee note at bottom of Table VI.— Part I. 

It should be noted in connection with the above figures 
resulta from the fourth grade pupils were secured during 
we^ of school in September, so likewise those from the ' 
ffrades. All other results were obtained in June. 



that the 
the first 
'■'5 & 3" 
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Combination. 


z . . . . 


Combination. 


No. Errors. 


12 X 11 

11 X 10 

12 X 10 


11 X 3 

10 X 

10 X 7 


99 

94 

86 


9X7 (1) ... 


455 


12 X 2 


81 


8X7 (4) ... 


435 


4X4 


78 


ftx8 (7) ... 


422 






10 X 5 

8X2 

5X4 

6x2 




» X 6 (2) ... 
8X8 (3) ... 


390 

.... 361 


68 

55 


8 X 6 (6) . . 


.... 342 




11 X 2 




7X6 (6) .. 


.... 285 




9x2 




7X7 (8) .. 
9x9 (10) . 


268 

.... 263 












.... 241 
235 






8X4 (9) ... 






10 X 2 

11 X 1 

4x1 

3x1 
































3X3 

flxi 

3X2 

7x1 
































12X1 

5X1 












133 

































Discv^sion. — Table X shows the errors wliich were made in 
the same kind of a test in multiplication as was given in addi- 
tion. It represents the tabulation of over 13,000 errors. The 
average number of errors for each boy was 10.8, that for each girl 
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11.2. As this was essentially a feet in power of .retention, the 
boys seemed to possess that power in tlie ease of mnltiplioation 
2.7% in excess of the girls. A comparison of the details shows 
little or no difference between the boys and the girls until 11 X 8 
is reached. From there to 12 X 13 the percentage of ertors 
made hy the girls is constantly higher than that made by the hoys. 
A comparison of the tables in which 7, 8, 9, and 12 appear as the 
first factor shows practically no difference until 12 is reached. 
Here the difference is marked, being nearly 1 % in the favor of the 
boys. With the 10th and 11th rows the advantage is also with the 
boys. With the 6th and below the advantage is slightly with the 
girls, but it is so small as to be almost disregarded. If would 
seem, Uierefore, that boys have a retentive power for larger prod- 
ucts ifi excess of that possessed by the girls. 

As bas been already explained, Professor Doring's experiment 
extended only to 10 X lOi A comparison in Table XI with the 
order established by his investigations shows that otily 9X4 and 
10 X lO of the numbei's coming undef his consideration crept into 
his ten most difficult eombinations, and that only the first place 
of difficulty in the tv/o experiments agree, though a general 
agreeflient as to reldtive order of the other places, wltli the ex- 
ception of his 4th and 7th places of difficulty, is to be noted. 
One *0Hld fhlfik that 10 X 10 would have Very few ertofs, but 
the ciithbination appeared so oft«n at "10 X 10 = 110." The 
"10" Sequence established in the part of thfe problem Carried 
over with disastrous rfesUlts into the product 



2. E&BORS in Pd^CES^ 

Errors iri froeess were bot counted In the mnltiplieati&n tests 
just described, for thfe sfiiae feasons given for not counting them 
ifi the additioti testsi flowever, ifi otAet to sboW Uie relation 
which the number of such errors bore to other errors the fol- 
Iftwifig ta^te 6<*Stitiitiag fecords foJ* 728 thitd grade pupilfl is 
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BHOmNO 7HB IHUMHPB 

tnmt efMW paaanKs. 



GoBibiBatioB- 



p 


O 


94 


31 


43 


10 


^ 


ss 


g2 






12 


27 


J« 


26 


18 


26 


« 


% 


is 


32 




SO 


«i 


;» 


» 




« 


M 


9 


35 


}4 


24 


18 


;?» 


u 








1« 


!» 


7 


2J 


IT 




■28 • 


■24 


♦4 


«8 


12 


ai 


»i 


27 


?0 




38 


se 


a« 


2^ 


77 


^ 




20 


l« 


17 


63 


22 




<W 


5? 


28 




19 


«? 


20 


»6 


24 


113 


ts 


189 


20 








23 


142 



6 XI 

7 

«,,.....,. 

» ..., 

10 

11 

2 

■(.,...,.,.. 

6 

«,,,.-,.,, 
7?!:?,,.,, 

8 

»..,,,..» 

10.., 

11.,... 

12.,.- , 

a, 

5,,- 

«....,.,.. 

« 

10 

W 

12 ,.. 

i. 

«.„..-.,.. 

7 ,,. 

8X¥..,.. 

«,..,..,,., 

W „. 

U 

12x4 



7,„ 

8... 


;;;;;;;;;;:: 


to... 




18 X 






§ .„ 

9 ,...,.,,.. 




8 


»X 






12 ,..., ■,. 


8X8 ,.,.. 

« 


^fi„, .„,.,, ,,,,,. 




»■.■-■. ^, ..,..„..„ 


Wxl 
■Ux 
12 X 

^2x 

12X 


«..„„„„. 
0,..,.., ...... 


j^.-.-.-^,,,,. 


i..;... ..,,,.. 
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Discussion. — -An examination of the above table shows that the 
predominance of errors is found in the doubles, especially in 
1X1- The small number in 2 X 2, compared with the other' 
doubles, is due, of course, to the fact that the product and the 
sum of this combination are the same, so it was frequently im^' 
possible to tell from the context whether the pupil had added 
or multiplied. 

Here again it was thought best to count only errors which 
could not be subsumed under the head of process or of inversions. 
The number of inversions was so small, however, a8 to be neg- 
lected, there being only 22 in all, 8 of these being in -9 X 5 and 
4 in 9 X 6f which, of course, is significant. 

Discussion. — The summary of the results so far obtained in mul- 
tiplication is shown in the above graphic representation ((Jrnph 
VI). The most interesting thing noticed in a study of the. three 
"curves" recorded in this figure is their similarity and their dispar- 
ity.. Up tolO X 5 the similarity between the values of the tptal er- 
rors co-efficients of difficulty and the per cent of errors made by 
1,215 children is very striking indeed. At this point a diversion 
begins which constantly increases to the end ftf the scale, yet coin- 
ciding in direction in almost every point. Up to 10 X 3 the per 
cent, values' are almost invariably lower than the total errors co- 
efficients of difficulty values. " From 10 X 3 to 10 X 5 there 
seems to be a stru^le for supremacy, as it were, in which first 
one of them then the other succeeds, but after 10 X 5 the per 
cent, values are almost invariably higher. This, of course, results 
from the relation which exists between the two kinds of co-effi- 
cients shown in the figure, the learning co-efficient of difficulty 
having in it the same elements, though differently treated, as 
are contained in the total errors co-efficient. 

The most significant relationship, however, lies in the com- 
parison of the learning co-efficients and the per cent, of error. 
Up to 10 X 4 the former are invariably higher than the latter; 
then comes again a struggle for supremacy, as it were, lasting to 
about 10 X 6. After that point, with one notable exception, that 
of 9 X 7, the learning co-eifieients are lower to the end of the 
series. While their divergence constantly increases, the value 
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TABLE XIU. 



SaowINO TBE KUUBBB O 



Before Vaoatian. 



After TaoaUan. 



i i 

8 

1 

1 

1 

2 

i'.'.'.'.'. 
2 

i....) 

1 , 

2...,.^ 





1 
2 
i 

2 
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TABl^ KlU.~Conim»ei. 



SHOWING THB MCK8EB OF 


AFTEE SUKMEB TACAIIOH. 


rvpoM bbpom; anb 




Btf«n Vacttisn. 






Grade 


Z 


2 


1 


TottL 


8 


2 


1 


Total. 


Increase. 




3 
29 
30 

W 

38 

9 


..... 

4 

1 
4 

1 


1 

3 

S 

1 
3 


4 
34 
86 

. 12 

45 

10 


: 


7 
9 
» 

13 


2 
5 

4 

3 
6 

1 


18 
M 

58 

22 

55 

20 




a+v::::::: 


12 


8+8 


10 


9+& 


10 



SHOWING AK»nos FACZe ABKANOEO IN THX OBDBB OF 7^! nS CBnX. FOBUOITEH 




Low Per Cent 




Irf« Per Cent 
1,3 




4.1 














3.8 








6 + 4 


































8 + 7 


2. IS 














































2 + 2 


























7 + « 

3 + 1 


1.6 

1.4 


8 + 1 


..... ~*.2 


8 + S ...... 




e + 2 


1.3 
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Discussion. — In the study of Graph VII and Table XIV a 
word of warning is necessary. They aJone should not be "made 
the basis of any teaching practice. One point in the figure and 
table will serve to illustrate. It will be noted that at 8 -|- 5 there" 
is an actual gain in knowledge, indicated by the "curve's" fall- 
ing below the zero line, while the per cent, of loss for 7 + 5 is 
the maxiraum for the whole figure. This does not mean, that in 
the process of review of the facts of addition that much em-. 
phasis should be, placed upon the 7 + 5 fact and little or no 
attention should be given to the 8 + 5. The same point is to 
be noted with the high and the low values throughout the "curve." 
In the case above cited, only 17 errors appeared for 7 + 5 in 
the June tests while there were 43 for 8 + 5, Greater oppor- 
tunity for Joss was, therefore, presented by the former than for 
the latter. In the September tests there actually occurred five 
fewer errors for 8 + 5 than for 7 + 5. This figure and table 
should be studied in connection with Table VII and the cor- 
responding part of Graph V. 

The value of Table IX and Graph VII lies in this fact : 
they point out the relative stability of the combinations from 
the standpoint of memory. 
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TABLE XTl. 



BHOWINO MUl 


TIPUCATIO 


N COllBf NATIONS 


IR TBI 


OB&BB or tHX t 


IB CKNT. 




FOMOT 


TEN DITRINO THE BTFUUeB V 


iCATlON. 






Loss. 


CombiuBtloQ. 


LOM. 


CombinaUon. 


Lo«. 




% 




% 




% 


12x9 


. 23.4 


8x8 


. 5.66 


7X5 


. l.l 




. 19.2 


7X3 


. 5.3 


5X2 


. 1.1 


8x7 


. 18.5 




. 5.1 




. 1.1 


12 X 8 


. 17.9 


6X5 


. 4.5 


3X3 


. 0.9 


■9X9 


. 17.6 


11 X 7 


. 4.3 




. 0.76 


9X7 


. 17.0 


12 X 3 


. 4.3 


2X2 


. 0.6 


12X11 


. 11.9 


9X3 


. 4.3 




. 0.4 


12X10 


. 11.9 


11 X 8 


. 4.15 


11 X 2 


. 0.4 


12 X 7 


. 11.7 








. 0.4 


8x8 ..... 


. 11,3 


8X2 


. 4.16 


8X1 


. 0.4 






11X9 


. 3.8 


11 X 1 


. 0.2 


9x4 


. 11.1 


11 X 3 


. 3.6 


2X1 


. 0.2 


11 X 10 


. 10.4 




. 3.6 







9X6 ..:.. 


. 10.2 


0X2 


. 8.4 


10 X 2 





8X4 


. 10.2 


10 X 6 


. 3.2 


12x1 





12x12 


. 10.0 


12X2 


. 9.0 




. —0.2 


7X7 


. 9.46 


9X2 


. 8.0 


6x1 


. —0.2 


12X6 


. 9.46 


12 X 4 


. 2.6 


10 X 8 


. — 0.6 


12 X 5 


. 8.86 


10X10 


. 2.3 


4x4 


. —0.6 


8x6 


. 8.7 


7x2 


. 2.8 


10 X 6 


. —0.76 


7x6 


. 8.3 


5x4 


. 2.1 


7x1 


, —0.76 


flxfl 


. 1.0 


3X2 


. 2.1 


6x1 


. -fl.75 


8X5 


. 7.0 


11 X 5 


. 1.9 


4x2 


. -0.9 


11 X 6 


. 6.4 


10 X 3 


. 1.7 


3x1 


. —1,3 


7X4 


. 6.4 


4X3 


. 1.5 


11x4 ..... 


. —2.45 


11 X 11 


. 6.06 


8X8 


. 1.3 


4X1 


. —3.2 



Note. — Tbe oegatlTs valneg IndlcBte gain Inltiad «t lou. FvtctliUfea iK al- 
culated OD tbe basis of nnmber of etton pouible, 

Disevaiioiu-^ll is intereflting to compdre the order in Table 
XVI with that arrange on the bflais of number of errors made by 
1,216 pupil*, shown In Table XI. It will bft obeerved in this com- 
parisoh that the 21 iWtnblBatioiis which atand highest in Tabl* 
XVI are to be fotind among the first 23 combinations that appear 
first in Table XI. The next group of 10 in Table XVI is to be 
fotindt with a few exceptions, in the corresponding part of Table 
XT, and so on, but there is no other similarity in the tsblM that is 
apparent. 

The ratio between the pel* wnt. of loss to the per cent, of error Is 
far from constant. If the vftlue reprftuwiting the lack of stability 
of the nnmber facts bore a direct relation to the number of enow, 
this relation should be constant throughout. 
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The same wanxing to which attention was called in regard to 
the application of Graph VII must also be issued here with refer- 
ence- to the use of Graph VIII. If must be studied in connection 
with Graph VII, especially with reference to that part showing 
the per cent, of errors made by 1,215 children. 



XVI. VACATION SCHOOLS. 



Of the 558 children included in the addition tests some over 100 
attended sdiool from one to four weeks during the summer. That 
this fact did not materially, if at all, affect the results for the whole 
group is shown by thefoUowing: The ratio between the number 
of errors made in June to the number made in September by 112 
pupils selected at random, from those who did not attend vacation 
school was found to be .896 ; while a similar ratio for 112 children 
who attended vacation school was .815. What would have been the 
ratio for those who went to vacation school, if they had not at- 
tended is impossible to say, but whatever may have been the effect 
of instruction during the short- summer period, it was not sufR- 
eient in this particular to bring the standing of those who took ad- 
vantage of it up to that made by those who did not 

In the, comparative multiplication tests the ratio of the number 
of errors in June to the number of errors in September for 112 
pupils, selected at random from those not attending vacation 
school, was found to be .735 ; while a similar ratio for the same 
number of diildren who did attend vacation school was .716, the 
results again being in favor of those children who did not go to 
school in summer. 

Since all the pupils in each case were promoted to the next 
higher class, we might presume that the vacation school was made 
up largely of those who may have stood low in their dass. In any 
case, the fact that one-fifth of the pupils did attend school from one 
to four weeks during the summer cannot greatly influence the re- 
sults of these comparisons. 
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XVn. SELATIVE DIFFIOULTT AS INDICATED BY SKILL 
IN MANIPULATION. 

1. PLAN AND NATUBE OF THE TESTS. 

There remains but one other important test for the determina- 
tion of relative difficulty, and that is the test of skill in the use of 
the combinations. To determine this the forty-five addition com- 
binations were divided into nine groups of five facts each. These 
groups contained the same combinations as the groups used for 
teaching the facts in the first part of this investigation. The 
seventy-eight multiplications were divided into sixteen groups in 
like manner, except that the fourth group was inadvertently made 
to contain four combinations instead of the second group. 

For conducting this part of the experiment the combinations 
were arranged across a sheet of paper as shown below, the same 
being a reproduction of Group 3 for addition : 

(3) 2724272242326 



There were usually about 15 examples in all, the purpose being 
to have more than any one pupil could do during the time allotted 
for each group. It will be observed that after the first five facts 
in the .row the same facts are repeated in different order and in 
reverse form and direct form, so that no order or answers could 
assist the pupil in writing the products more rapidly than his 
normal rate would be for the first five sums or products, as the case 
might be. The nine groups were thus arranged for the first test in 
Tegular order down the page. For the second test the groups were 
arranged in reverse order, and for the third test the following 
order was given : 6, 7, 8, 9, 1, 2, 3, 4, 5, The object here was to 
equalize the effects of fatigue. Across the top of each sheet was 
typewritten, "Write the sums of the following numbers from left 
to right." 

On the back of each sheet were mimeographed the answers of 
the various combinations in the order in which they appeared on 
the face, with a short line drawn under each. 

These tests were given to the A and B classes of the third and 
fourth grades. 
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2. THE OBJECT OF THE TESTS. 

The object of the experiment was first to determine the time re- 
quired to write the sums of the various groups, or the products, as 
the case required, on the face of the sheets, then to determine the 
time required to copy the answers on the back of the sheets. By 
subtracting the time for the latter almost purely mechanical part 
from the former, a time representing more nearly the net time re- 
quired to think the results would be obtained. That group requir- 
ing, therefore, the longest time to think out was adjudged the most 
difficult. 

3. MANNER OF CONDDCTING THE TESTS. 

The experiments were conducted personally by the writer and in 
the following manner : To each pupil there was given a she^ of 
white paper on which were mimeographed the combinations as 
above described. Covering each white sheet was a blank yellow 
sheet of the same size. This completely hid from view the work to 
be done. It was then explained that on the white sheet there was a 
number of rows of little examples in addition (or multiplication), 
the answers to which were to be written as fast as possible on the 
giving of a certain signal. The arrangement of the examples was 
shown on a sheet in the hands of the experimenter. He then showed 
how the yellow sheet was to be pulled down to disclose one row at a 
time at the signal, "papers down," and how on the signal of 
"write," given immediately after, the popils were to write as many 
of the answers as they could until the experimenter said "stop," 
after which the papers were to be pushed up over the row just writ- 
ten. This was to prevent additions or corrections. At the nest signal 
"papers down," the neJrt row below was to be exposed and as many 
answers in that row were to be written as time permitted. A rest 
of from five to ten seconds was givai between the writing of each 
row. When the last row had been written, the papers were turned 
over and all th« answers <m the back of the sheet were exposed at 
once. It was then explained that these were to be copied in the 
place indicated by the mark under each and from left to right 
across the page, the work to begin at a certain signaL Hie signals 
used for this part of the teat were as follows: (1) "Ctet ready," 
which meant put the pencil where the first answer was to be 
written ; (2) "write," which meant that as many of the answers as 
possible were to be copied until the third signal, "stop," was given. 
Five or ten seconds' rest was allowed between each row. The order 
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of these groups of answers was made to follow the order of the 
groups of examples on the other side of the sheet. 

For the third grade addition tests 15 seconds was the time 
allowed for writing the sums of each group, and 5 seconds for the 
answers. For the fourth grade 10 seconds and 5 seconds, respec- 
tively, were allowed. 

4. METHOD OF EVALUATING EESULTS. 

The niimlier of sums or products written, and the number of 
answers copied, were arrange<l in the tables of frequency which 
are given below. In these the horizontal row of figures at the top 
of the table represents the groups involved, the vertical row on the 
left-band margin represents the number of results written or 
answers copied. At the bottom of each table is given the average 
number of results written and the average number of answers 
copied for the various groups. On- this basis is calculated the 
number of seconds required to write the five results or to copy the 
five answers of the group. The difference between these values for 
each group gives the number of seconds required to "think" the 
sums or products. 

In order to test the validity of the results obtained, the average 
deviation is calculated for each of the averages; the standard de- 
viation, the P. E. and the P. E. in seconds required to do five 
combinations are calculated for the maximum and minimum aver- 
age deviations in the sums and products, and for the same groups 
in the answers copied. For the method by which these calcula- 
tions were made the writer is indebted to Professor E, L. Thorn- 
dyke (44). For calculating the P. E, in seconds to do five com- 
binations, the following proportion was used : The P. E. in seconds 
required to do five sums or products or to copy five (snswers (x) : 
the number of seconds required to write five sums, &c. :: the P. E. 
m combinations written in 5 seconds : the rmmber of comhino' 
iions that are wrUten in 5 seconds. This will appear in the first; 
calculation of the kind made as follows : 

X sec. : 10.36 sec :; .28/3 sums, &c. : 7.24/3 sums, &c., a 
solution of which givee .4 as the P. E. in seconds to write five sums. 
The true average will, therefore, be seen not to vary materially 
from the calculated average in any of the eases as far as time is 
concerned. For a full discussion of the reliability of averages, the 
reader is referred to Dr. Tbomdyke'a book, Me>nt<d <md Social 
Measurements, already referred to above. 



./Goot^lc 





, 


e 












c 


s 


« 


« 




















lOlJrH 








<i 








Cassis-" 


- 
















„ 


CO 






-""SS"""" 


















■«i 








" :SKS3»«~ 


0.^ 












- 


a 








-^SSaS" : :" 


-^ ! 












< 










„«,j;»-„ >«- 




t^«tH 








« 


a 






- 


"SSa"'""" : :- 












■4 










c,»«g,3j,„„»«ffl», : 


^ooSSsI 




« 


a 










""S-S""""" :" : 










■< 










l-asas""-"""- i 


Sl^s 








' 


a 








-"»2333— : 








4 


i 


< 










-""iSSS""" 


a, ■ 






•4 


c 


CQ 








" 


-ssss"-" : 












1 


■< 












-""aasa"'" 


t- 








. 


a 






" 


"ass-°" ■■-" \ 












<i 








-"""SBS-S"""- : 










- 


n 










""Saa"""" : : : : 










■a] 












-=-SSSS"='-'S : 










i 




1 




1 

1= 








* 










ec 


c 












s 


'■i '■ 

■£«■ 

i= 


(1. 


i 

% 

2 

i 

s 

B.' 



ogle 



: i'2.2.2 



ogle 



t4 Sg 

ii 



, 


« 


• ■ ; • ;ssa 


^" : : : i : : 2 


■fl'6 ■ ■ 




-fl 


; : : ; :-'aS 






. 


B 


, , , ,,.„g^ 




■O 


: ; ; ; ;2"S 


goc : : : : : :...o^SS 


- 


CQ 


; : : : :gKS 


5,^ : : : : : „^<coSS' 


->5 


MIM"* 




,= 


: : ; :-«sqi 


SSirtlH ■ ■ ■ . eSWQO ■ ■ 

" : : : : teccd '- '■ 


: 


^ ; M ; ; ;-^ 


H«oM : : ; : '^R'l : : 






ffl : i : : i'Sg 


«"";;;; °;i:3'5 


3 


9 " 


<! j : : : :" :^» 


sass"" : : ;5;322 


3 
= 1 


5 


" i ; ; : ; ■."'^^ 


ssa'!;;; SS°"Sil 


S 


■< 


^f- 


ssss-»n ^ssss 


!' 




» 


; ; ; i" :"' 


°8S"" ; i i JJ2 : : 






- 


::::::■"' 


sssss": 13:;;; 


:| 


c 


" 


: ; : ; Has 


SS""-" ; ; 52^ ; : 


1 , 


< 


; ; ; : ; I"" 


^SSiS-" ; : 552 : : 


: 


- 


» 


; : : : : :aS 


^s-— ; ; 25223 


5. * 


o 


: : : : : :"* 


jjisaa'""" 55SS5 


J ' 


O 


i 


1 : ■ : : i i i : 

z 








»=»S3323!5 2 


2S£^£ 





Ibi 

jjl 



Cioo'^lc 



« 


n 






33SS 


!iS< 


« 












< 




■"•aaaa— ""- ; 


• t^w',^-; : '■ '■ 


ao 


A 


:" 


saEss""^'' 






*g«»- : : : 


■4 




-"•sas-s"' 




<D<pOOCe»^ ^ ; ; 


f 


03 




■•KSSSS""-" : 






< 




i^aasssss"" ; ; 




•a 


S 




■•ssssa— - : 




l-<»«M« . . . 


- 1 n 


: :-"S2SSSa"" ; 


-IWOWO ; ; 


« 1 -1 


:'-S32SS«"'--' 






S.3 
4.7 
1.6 
1.0 
0.13 
O.M 


"'I : ; 


: :""»BSa5»-'- ; 


8.2 
6.1 
8.7 
3.4 
1,6 
1.8 
0.12 
0.09 


g 1 : : 


:">-SSa"'3=»-"-- 


7.5 
6.7 
3.0 
8.7 
2,0 
2.3 
0.16 
0.14 


-i i i; 


: : :"«SsaSS«» ; 


a o oi oi M oi d d 


OJ 


B 1 11 


: l^^aaSKS"-"'" 




■< i : ; 




d^Sn^ : : : 


- 


« ! : ; 


: ; :— 23?Sf.»""- 


ooon^M '■ - '■ 


■< .1 : : 




ot f a ^ (- j2 o g OT as 


dq^fisin : ■ ■' 


n 


B j ii 




•'•assas-"" 


9.8 

2.1 

1.7 
2.1 
0.14 
0.0T3 


< 








— -asss-s 


«'»ei--o*«Jdd 


I 




1 




1 : ; 










es 


= 




232 


SSSSSsBs 



3} 3 






Hi 



ill! 
lill 

|ae . 
<:zzz 



, Gooi^lc 



«m 



„Gooi^lc 



Discussion. — A study of Graph IX. demonstrates the growth in 
skill from the 3-B to the 4-A class. It also shows a rapid slowing 
up on the work as the groups contain larger numbers. From the 
standpoint of skill, we can, therefore, say that difficulty in addition 
increases as the magnitude of the nninbers increase — that is, 
within the limits of tlie forty-five elementary facts. 

Tables XVI and XVII will sufficiently demonstrate the method 
pursued in the study of facility in the use of the combinations to 
justify the omission of the details of Tables XVIII and XIX ex- 
cept as to the averages, &c., which are given in detail below. The 
original tables of frequency will be found on file with other details 
of this investigation which space will not allow us to give here. 
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TABLE XVIII. 

flHOWINQ rOK A AND B CLABB THIBD OBAOB FUFIU TBI NITMBEB OF PBODDCTB 
WBITIBN ra 10-25 SECONDS IW THE TAWOBB 11UI.TIPLICATIOIT QBOUFS, THK 
NTTIfBBB OF Afl^HWEBB COPIB> IN BECOND8, ASO OmNO THE TIMS OBUJTtMtD 

TO "think" the fboducts fob the bame aBoupa. 

1. AN8WXB9. 





(1) 


(2) 


(3) 


(4) 


(5) 


(6) 






7.73 

7.92 

8.93 
7.23 

,.=4 

5.94 

5.76 
5.55 

6.32 

4.8 

G.98 
4.45 

».» 

4.73 

(t.Ol 
4.45 

5.50 
3.8 

5.51 
4.57 

6.07 
4.43 

4137 

5.63 
4.89 


2.76 
3.23 

2.76 
3.16 

2.8 
3.45 

3.31 

(2.65) 
4.21 
(3.36) 

4.37 
4.50 

3.96 

5.21 

4.18 

4.42 

5.28 

4.16 
5.62 

4.5 

6.58 

4.54 
5.47 

4.12 
5.64 

4.25 
5.72 

4.44 
5.72 


1.6 
1.5 

1.6 
1.61 

1.98 
1.61 

1.46 

1.13 

1.59 
1.00 

1.22 

0.86 

1.05 

°:» 

0.98 

1.3 

1.06 

1.44 
0.7 

1.00 
0.72 

1.46 

0.74 

1.2 
0.96 

l.»7 
0.78 


2.07 
1.98 


0.15 
0.19 


0.05 

0.08 




2— A 


















B 
















B 


























1.87 
1.16 


0.14- 
0.11 + 


0.09- 
0.12 
















1.45 

1.52 


0.11 — 
0.15— 






0.16 + 














2.15 
0.91 

1.29 
1.07 


0.18+ 
0.09— 

0.10— 
0.10+ 














0.12+ 














1.65 
1.26 

1.59 
1.07 


0.12+ 
0.12+ 

0,12— 
0.10+ 












B 


0.13 + 



ivGooi^lc 



TABLE XVIII.— Condnued. 

AND B CLASS THIBO OKADE PUPILS TBI 
10~-2!3 SECONDS IN TUB VABI07S 
NUMBEK OF ANSWBBS COPIED IN 5 SECONDS. AND OIVI 
TO "THINa" THE PaODOCTS FOB THE SAME GE0UP8. 



Grou 


(1) 


(2) 


(8) 


,4, 


(B) 




■ 






5.26 

4.16 

5.06 
4.04 


4.T5 
6.01 

4.94 
(S.Mi) 

fi.l9 
<4.9B) 


1.05 

O.T 

1.12 

0.82 


















1.82 


0.12— 













) Average number of answen copied In G Beoonda. 

) Average niimbcc of aeconds required to copy B anawera. 

) Average deviation from the aTerage nnmber of anawera. 



(4) StBDdard del— 

(C) P. E. Id number of i 
(6) P. E. In seconds reqi 
ambera In pav"""""'" "" 



red to copy 6 anawers of each group. 

Koupa 4 and 10 Indicate the time required to 
. group.) 
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TABLE XIX. 
PBODTTCTB. 



Groups ... 


(1) 


<2) 


(3) 


<., 


(5) 


(6) 


(7) 


(8) 


1— A' ... 
B .... 


10.72 

&.47 


4.63 

7.92 


2.76 
3.23 


1.9 

4.7 


2.84 
3.4 


3.33 
3.97 


0.25 

0.38 + 


0.11— 
0.31— 




11.. 57 


4.32 


2.76 


1.6 


2.4 


















R.21 
7.00 


6.09 

10.71 


2.8 
3.45 


3.3 

7.3 


2.04 

2.35 








B .... 










7.51 

7.25 


6.66 
(5.3t 
10.34 

(8.3) 


3.31 

<2.6) 
4.21 

(3.7) 


3.35 

(2.7) 
6.1 
(4.9) 


1.88 
2.3 


























7.25 
fl.79 


6.89 


4.36 
4.5 


2.5 
6,-55 


1.S7 

2.65 








B .... 









6— A .... 
B 


5.96 
5.61 


8.30 
13.37 


3.96 

5.21 


4.4 
8.2 


2.01 
2.27 


2.63 
3.1 


0.20 

0.2S+ 


0.28— 
0.68 , 




.,.82 
8.20 


8.59 
11.92 


4.18 
5.62 


4.4 
6.3 


1.74 
2.02 








B .... 








8— A .... 
B .... 


5.27 


9.49 

15.03 


4.42 

5.28 


n.i 

9.75 


1.&5 
2.31 


2.48 
2.75 


0.19— 

0.265 


0.34— 

0.8— 


9— A .... 
B 


fi.St! 
fi.16 

fi.l9 
8.35 


7.M 

12.17 


4.16 
5.C2 


3.5 

6.55 


1,98 
2.15 














10— A .... 
Bt ... 


9.16 
14.97 


4.5 
6.58 


4.7 

8.4 


1.88 
2.96 


2.3 
3.31 


0.17+ 
0.32— 


0.19+ 
0.47 + 


11— A .:.. 

Bt ... 


7.49 

7, IS 


10,01 
17.41 


4.54 
5.47 


5.5 

11.9 


2.12 
3.33 


2.65 
4.19 


0.2— 
0.39— 


0.27— 

0.94 + 




7.4 
7.45 


10.14 
16.79 


4.12 

5.64 


(5.0 
11.15 












2.51 








13— A 

Bt ... 


7.8 


9.93 
16.03 


4.25 

5.72 


5.7 
11.3 


l.fiS 
3.41 


2.26 

4.08 


0.17— 

0.39 + 


0.22+ 
0.81— 


14— A .... 
Bt ... 


6.9 

8.2 


10.87 
15.24 


4.44 
5.72 


6.4 
10.5 


2.11 
3.43 


2.65 
3.78 


0.2— 
0.36+ 


0.31 + 
0.67 + 


15— A .... 
Bt ... 


6.34 

8.08 


11. as 

15,47 


4.75 
6.01 


7.1 
9.5 


1.76 
2.80 
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TABr.E XIX.— Continued. 

PB0DUCT8. 



Groups . . . 


<1) 


(-') 


(3) 


(4) 


(6) 


(6) 


(7) 


(8) 


16— A .... 
Bt ... 


5. SI! 
6.7 


12.80 
(10.2) 

18.66 
(14.9) 


4.94 
(3.9) 
6.19 

(4.9) 


(6.3) 

12.5 
(10.0) 


2.15 
2.61 


2.6— 
3.06 


0.195 
0.29 + 


0.43— 

0.98+ 



a mark Biter clau letter indlcatea tbat IS aecande were glTSD for each 
■ • after the cIbbb letter showa that 10 aecoDdg were allotted. The t 
lus letter IndlcHteB that 26 aeeonda were given to tbe corresponding 



(1| Average number of products ^ 

(2) Number of seconda required ti 

(3) Number of seconds required ti 

(4) Number of Becoods recjulred ti 

(5) Average deviation from avera 
(d) Standard devtatloD. 

(7) P. E. In number of comblnatl. 
(8( P. E, m number of Becondfl n 
(The numbers lo parentheBla foe _... 
trite tbe four prodoctE Id the group.) 



hluk" 6 eomWnat 



(From Table XTIII, 1.) 
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SBOWINO FOE A AND B CLASS PUPIU OF THE TOUBTH OBADK THE AVERAOE MtlM- 
BBB W AKBWEU COPIED IH 5 aECDNDS, THE NUUBEB Of SECONDS REOVIBBD 
TO COFT FIVE AH3WEBS. ETC. 



Groups 


(1) 


(2) 


(3) 


«> 


(5) 


(«) 






10.88 
8.94 

10. 4& 
8.T1 

9.38 
7.»8 

7.6 

e.sr 

6.66 
6.00 

5.92 
6.23 

5.93 
5.20 

5,80 
5.07 

5.47 

4.98 

6.05 
5.08 

6.20 
5.01 

6.21 
5.05 

5.96 
4,89 


i:l 

2.4 
2.87 

2.67 
3.13 

3.19 
(2.e3> 
3.64 

(2.9) 

S.55 
4.29 

3.75 
4.17 

4.22 
4.78 

4.22 
4.81 

4.31 
4.93 

4.57 
5.02 

4.13 
4.92 

4.03 
5.00 

4.02 
4.95 

4.19 
6.11 


1.78 
1.22 

l.Bl 
0.84 

1.S8 
0.96 

1.2T 

0.72 

1.39 
0.70 

1.1.3 
0.66 

1.03 
0.61 

0.89 
0.78 

1.00 
0.68 

1.19 
0.61 

1.09 
0.56 

1.09 
0.58 

1.00 
0.69 

0.93 
0.62 


2.1 
1.7 


0.142 
0.U5 


0.03 
0.036 




a— A 



















B 








4— A 
















5— A 


















1.44 
0.94 


0.097 
0.063 


0.054 
0.044 
















1.1 
0.95 


0.074 
0.064 


0.052 
0.069 
















1.46 
0.88 

1.30 
0.81 


0.098 
0.059 

0.094 
0.054 






























1.26 

0.88 

1.25 
0.81 


0.086 
0.069 

0.084 
0.064 












B 


0.066 
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TABLE JLH..— Continued. 

:.ASS PUPIL8 OF THE FOURTH t 



Groups 


(1) 


(2) 


(3) 


(4) 


<B) 


(6) 






5.67 
4.72 

5.23 

4.23 


.a 

6.3 

4.78 
<3.S) 

5.91 
(4.7) 


1.08 
0.67 

1.00 

0.62 


















1.15 

o.so 


0.078 
O.ffiW 












NOTB.— For eiplanatl 




e to Table 


XVIII, 1 









ivGooi^lc 



TABLE XXI. 

OWING FOB A AND B CLASS PUPILS OF THE FOUBTH ORADE 1 

PBODCCTS OF THE VARIOUS UULTIPLICATION OHOUPS WBITTEN IN 10 Bl 

ALSO THE NUMBER OF SECONDS BEQUIEED TO "THINK" THE FTVK (OB FOUB) 

COMBINATIONS OF BACH OBOUP. 



Groups . 

1— A . 
B . 

2— A , 
B . 

3— A . 
B . 

4— A , 

B . 

5— A , 
B . 

6— A 
B . 

7— A , 
B . 

8— A , 
B . 

9— A , 
B , 

10— A , 
B . 

11— A . 
B . 

12— A , 
B 

13— A 
B 

14— A 



(2) (3) (4) (5) (6) 



10.16 
7.35 

9.75 

6.65 

8.18 
5.46 

4^86 

4!0T 



(4.1) 

7.5 
(6.0) 



3.92 

7.12 



(1-5) 
3.9 
(3.1) 



14.97 

6.43 
13.01 



5.03 
5.0 

4.02 
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TABI-E XXI.— Continued. 



COMBINATION a C 



I'DS BEQUIBEU T 



Note. — Foe eipla nation. 



e Co Table XIX. 



Groups '...., 


(1) 


(2) 


(3) 


(4) 


(0) 


(6) 


(7) 


(8) 


i^i 


4.82 
1.53 


10.06 
21.0 

10.37 

(8.3) 
32.68 
(26.0) 


4.41 
5.3 

4. 78 
(3.8) 
5.91 


5.6 

15.8 

5.6 

(21.4) 


1.4 
1.3 

1.7 

0.6 
















B 


2.0 

1.037 


0.135 

0.069 


0.29 
0.148 
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Discussion. — In giving these multiplication tfsts the sixteen 
groups of facts were divided into two parts, the first part consist- 
ing of the first ;iine groups in their numerical order, and the 
second part of the last seven groups. These groups were given 
first in their regular order, then the second part- was given first, 
and finally in the third test the order of the groups was reversed. 
This plan had for its object the equalizing of tlie effects of fatigue, 
distributing it as nearly as possible throughout the whole series. 

A study of Graph X shows a tendency upward throughout the 
"curves" in somewhat the same manner as the "curve" of errors 
in Graph VI, The most remarkable thin_g about this figure is the 
irregularity of the "curve" for the 4-B class. In the natural 
course of events it should fall bettveen the "curve" for 3-A and 
that for 4-A as in Graph IX. This curve is doubtless due to the 
fact at the time these tests were given the 4-B class had been 
engaged for some time in studying the addition and subtraction 
of simple fractions. The test caught the 3-B class drilling on 
the latter part of the tables, hence the increase of skill noted 
in that class from the 11th group on to the end. 

The two values given in groups 4 and 16 are due to calcula- 
tion on the basis of both 4 and 5 combinations, the 5 combina- 
tion value being the higher. 

An analysis of the four "curves" shows that groups 3, 6, 8, 
11, and 16 present a marked degree of difficulty from the stand- 
point of skill, as compared with the groups adjacent to ttem. 
Groups 2, 4, 7, 9, and 12 are correspondingly easy. The fact that 
group 1 shows higher difficulty than group 2 is doubtless due to 
the errors of process made in 1 X 1? which were in these tests 
counted as errors. Arranged then according to their relative dif- 
ficulty, beginning with the easiest, the groups would take the 
following order: 2, 1, 4, 3, 5, 9, 10, 7, 6, 8, 12, 13, 14, 15, 11, 16. . 

A comparison of Graph X with the per cent, of errors part of 
Graph VI shows that skill in the manipulation of the combinations 
as represented by time is in inverse ratio to the number of errors 
made, the high points of each "curve" being in practically the 
same relative positions. The like is also observed in the addi- 
tion by a comparison of Graphs V and IX. In other words, the 
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groups showing the greatest skill in handling are the groups in 
which the fewest errors appear. Eapidity in this case goes with 
fewness of errors. 

XVm. CONOLUSIOHS. 

1. In the process of learning each group of combinations power 
is developed whereby subsequent groups are more easily mastered. 

2. Girls learn the addition combinations with less difficulty 
than boys by about 10%, and make 10% fewer errors through- 
out the process. 

3. Girls learn the multiplication combinations with about 25% 
less difficulty than boys, and make about 13% fewer errors in 
the process of mastery, but boys retain 2.7% better than girls 
when the whole number of products is considered, excelling es- 
pecially in the larger ones, while girls excel slightly in retain- 
ing the smaller products. 

4. In the process of teachii^ the additicai facts fewer errors 
appear in the double numbers even when equal opportunity for 
making errors is provided, the fewest appearing in 5 + 5 and 
the greatest number in 8 + 8. 

5. In teaching multiplication the fewest errors appear in the 
lO's and ll's and the next fewest in the doubles after 3X3. 

■6. Gombijiations in the latter part of the series in both addi- 
tion and multiplication are more readily learned, but they are 
also more easily forgotten. 

7. From the standpoint of skill in manipulation, difficulty in 
addition increases with the magnitude of the mimbere. 

8. The groups showing least skill for their manipulation are 
the same as those showing the greatest number of errors. This 
shows close correlation between speed and accuracy, greater speed 
goii^ alc^ng with greater accura*^. 

9. The story of relative difficulty for addition facts is told in 
detail by Graphs V and VII. 

10. The story of relative difficiilty for multiplication combina- 
tions is told in detail by Graphs VI and VIII. 
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XIX. suoqEsnoNS okowiNo our of the 

INVESnaATION. 

1. The combinationa in both addition and multiplication should 
be taught in smaller groups than the ordinary tables. Five com- 
binationa per group is su^eated as best, giving as it doea an 
average of one new combination for each school i^ay of the week. 

2. In a group of five, or any other number of facta to be 
learned, it ahonld be remembered that the first and the last posi- 
tion are points of vantage, and that the hardeat combinations of 
a given group should be placed at these two points, and the 
easier ones in the middle. 

■ 3. Subtraction should be taught simultaneously with addition, ■ 
and as an additive process. 

4. Division should be taught simultaaeously with multiplica- 
tion. 

5. It is not economical to begin drills in addition facts before 
the beginning of the second half of the first school year. 

6. The multiplication combinations may profitably be begun 
in the second half of the second school year. They may all be 
taught in one term, if that term falls in the second half of the, 
year, but it is not advisable to attempt beyond 10 X 10 in this 
term. 

7. In both addition and multiplication, combinations should 
be taught in both direct and reverse forma simultaneously; as, 
2 + 3 = 5, 3 + 2 = 5; or 6X7 = 42, 7X6 = 42. 

8. No scheme of association, no number plays or games which 
have not in them as their predominant factor the idea and essence 
of drill, can take the place of systematic and persistent repeti- 
tion as a means of making permanent and automatic the correct 
reactions to the combinationa in addition and multiplication. 

Education has too long been philosophical. Every phase of 
the subjects taught in the schools is fairly bristling with un- 
solved problems — problems that are "settled" to-day in a dog- 
matic way and unsettled to-morrow in a dogmatic way, the sta- 
bility of the decisions depending upon the position and the per- 
sistence and the eloquence of the individual who renders the 
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dietniu. While the day of dictum is not over, the dawn of a new 
order of thinga in educational procedure has already begun. 
The only way in which pedagogy may write its name perma- 
nently among the sciences is by basing its conclusions upon the 
incontrovertible evidence of scientific investigation. This task 
is no easy one. It is too big for the individual investigator. He 
can at best only point the way. Such a study as this may posit 
conclusions only tentatively. There ahoidd be in every large 
system of , education a department for the investigation of the 
problems of the school room. This department might hope to 
make its investigations sufficiently extensive to render its con- 
elusions universally valid. Every large industrial establishment 
maintains such a department. It should be possible in the work 
. of education. 
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